-- Logs begin at Thu 2022-07-14 09:32:25 UTC, end at Thu 2022-07-14 10:32:03 UTC. -- Jul 14 10:05:07.253782 dv-cinder-849800-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 10:05:07.262858 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:05:07 2022] *** Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: nodename: dv-cinder-849800-1-iscsi Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: machine: x86_64 Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: clock source: unix Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: pcre jit disabled Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: detected number of CPU cores: 4 Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: current working directory: / Jul 14 10:05:07.264807 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: your processes number limit is 47680 Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: your memory page size is 4096 bytes Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: detected max file descriptor number: 2048 Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: lock engine: pthread robust mutexes Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: thunder lock: enabled Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 10:05:07.265423 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:05:07.309154 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: Python main interpreter initialized at 0x560091e869c0 Jul 14 10:05:07.309154 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: python threads support enabled Jul 14 10:05:07.309154 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: your server socket listen backlog is limited to 100 connections Jul 14 10:05:07.309154 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:05:07.309474 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:05:07.309566 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: *** Operational MODE: preforking *** Jul 14 10:05:07.309821 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:05:07.309821 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: spawned uWSGI master process (pid: 103283) Jul 14 10:05:07.310000 dv-cinder-849800-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 10:05:07.310950 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: spawned uWSGI worker 1 (pid: 103284, cores: 1) Jul 14 10:05:07.310950 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: spawned uWSGI worker 2 (pid: 103285, cores: 1) Jul 14 10:05:07.311112 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:05:07.981987 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:05:07.993428 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:05:09.102159 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:05:09.102159 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: from cryptography.utils import int_from_bytes Jul 14 10:05:09.102787 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:05:09.102787 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: from cryptography.utils import int_from_bytes Jul 14 10:05:09.105860 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:05:09.105860 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: from cryptography.utils import int_from_bytes Jul 14 10:05:09.106285 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:05:09.106285 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: from cryptography.utils import int_from_bytes Jul 14 10:05:11.578782 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:05:11.579310 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:05:11.579467 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:05:11.579820 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:05:11.580071 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:05:11.580451 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.580768 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.581126 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.581443 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.581768 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.582275 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.582607 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.582954 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:05:11.583336 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.583483 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.583748 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.583870 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:05:11.584063 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.584296 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:05:11.584389 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-1-iscsi {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.584665 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:05:11.584751 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.584946 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:05:11.585036 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.585309 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.585408 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.585627 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.585714 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.585932 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.586019 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.586253 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.586347 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.586559 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.586655 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.586900 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.587051 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.587226 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.587490 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.587614 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.587796 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.587891 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.588104 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.588208 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.588422 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.588541 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.588738 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.588832 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-1-iscsi {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.589070 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.589172 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.589384 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.589487 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.589686 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.589777 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590006 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590089 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590313 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590409 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590636 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590728 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-1-iscsi {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.590947 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.591047 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.591311 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.591445 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.591622 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.591759 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592031 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592120 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592345 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592436 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592651 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592748 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.592988 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.593098 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.593310 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.593396 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.593617 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.593723 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.593933 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594048 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594252 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594359 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594560 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594656 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594878 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.594974 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-1-iscsi {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.595176 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.595263 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.595483 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.595588 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.595794 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.595912 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.596111 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.596260 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.596414 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.596574 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.596719 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.596906 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597019 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597230 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597319 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597595 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597709 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597904 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.597991 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.598233 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.598325 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.598535 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.598638 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.598784 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.598881 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.599101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.599188 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.599420 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.599516 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.599728 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.599822 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600035 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600129 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600339 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600428 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600643 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600731 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.600971 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601084 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601231 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601318 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601542 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601629 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601849 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.601944 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602166 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602254 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602477 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602571 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602733 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602852 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.602988 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.603091 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.603309 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.603409 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.603633 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.603767 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.603944 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.604033 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.604251 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.604341 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.604558 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.604646 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.604868 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605007 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605237 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605335 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605555 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605643 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605863 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.605948 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.606166 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.606253 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.606468 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.606556 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.606770 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.606857 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607088 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607184 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607399 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607485 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607708 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607800 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.607957 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.608106 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.608254 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.608362 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.608554 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.608670 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.608869 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609038 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609196 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609363 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609500 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609675 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609803 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.609996 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.610084 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.610319 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.610413 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.610628 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.610715 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.610936 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611038 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611246 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611353 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611549 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611669 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611842 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.611930 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.612145 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.612233 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.612420 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.612514 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.612723 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.612833 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.613059 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.613655 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.613902 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614007 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614212 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614300 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614515 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614603 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614818 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.614920 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.615120 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.615207 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.615429 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.615516 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.615730 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.615830 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616030 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616124 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616334 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616426 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616639 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616778 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.616951 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.617044 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.617267 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.617362 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.617570 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.617658 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.617869 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.618156 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.618280 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.618465 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.618564 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.618766 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.618886 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619082 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619178 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619385 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619481 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619685 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619774 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.619981 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620076 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620277 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620372 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620574 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620668 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620871 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.620980 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.621191 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.621305 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.621490 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.621591 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.621783 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.621879 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.622095 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.622192 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.622409 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.622496 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.622713 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.622800 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623015 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623117 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623316 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623414 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623623 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623717 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.623947 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.624050 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.624258 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.624396 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.624567 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.624654 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.624874 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.624982 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.625208 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.625295 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.625515 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.625666 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.625824 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.625922 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.626129 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.626215 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.626435 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.626535 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.626738 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.626825 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.627055 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.627200 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.627363 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.627462 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.627670 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.627758 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.627982 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.628070 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.628292 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.628392 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.628614 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:05:11.628772 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.629515 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.629610 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.629855 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.629996 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.630153 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.630240 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.630463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.630561 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.630779 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.630867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.631107 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.631194 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.631426 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.631558 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.631738 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.631848 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.632074 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.632171 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.632401 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.632488 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.632712 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.632799 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633049 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633139 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633369 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633500 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633676 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633775 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.633975 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.634071 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.634292 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.634412 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.634608 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.634704 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.634924 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635017 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635231 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635324 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635541 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635635 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635848 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.635942 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.636155 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.636265 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.636461 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.636573 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.636770 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.636868 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.637099 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.637206 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.637433 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.637538 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.637745 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.637842 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638056 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638164 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638367 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638463 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638680 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638775 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.638990 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639092 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639296 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639390 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639603 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639904 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.639999 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.640207 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.640302 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.640508 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.640610 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.640813 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.640910 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.641138 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.641233 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.641453 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.641547 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.641763 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.641853 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.642064 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.642159 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.642394 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.642488 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.642697 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.642793 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.643003 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.643098 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.643308 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.643412 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.643613 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.643913 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644006 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644224 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644332 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644555 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644651 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644857 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.644984 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.645199 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.645294 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.645503 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.645591 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.645805 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.645892 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.646114 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.646205 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.646416 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.646502 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.646716 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.646802 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647026 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647121 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647330 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647419 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647636 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647723 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.647944 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648039 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648246 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648334 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648565 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648651 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648871 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.648999 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.649200 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.649287 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.649511 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.649604 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.649827 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.649921 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.650125 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.650211 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.650444 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.650529 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.650754 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.650848 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651061 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651156 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651444 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651665 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651753 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.651964 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652058 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652265 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652357 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652564 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652651 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652866 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.652986 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.653190 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.653279 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.653489 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.653571 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.653786 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.653871 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.654086 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.654180 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.654391 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.654474 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.654706 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.654791 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655006 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655104 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655305 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655391 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655600 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655692 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655899 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.655993 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.656235 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.656321 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.656534 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.656627 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.656858 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.656981 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.657196 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.657283 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.657502 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.657588 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.657809 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.657907 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.658116 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.658201 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.658418 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.658503 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.658723 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.658808 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659027 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659112 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659331 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659414 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659717 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.659961 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.660052 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.660270 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.660357 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.660574 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.660660 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.660878 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661007 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661211 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661297 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661517 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661603 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661830 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.661915 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.662128 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.662223 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.662436 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.662523 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.662770 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.662864 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.663099 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.663202 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.663408 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.663495 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.663723 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.663809 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664028 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664125 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664340 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664432 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664642 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664736 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.664966 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665275 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665369 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665578 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665664 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665890 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.665985 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.666194 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.666281 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.666505 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.666591 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667061 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667156 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667379 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667681 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667774 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.667992 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.668086 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.668293 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.668379 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.668599 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.668696 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.668918 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669023 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669266 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669368 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669570 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669675 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669874 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.669962 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.670188 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.670273 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.670492 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.670585 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.670797 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.670883 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.671103 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.671189 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.671405 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.671499 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.671706 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.671792 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672007 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672094 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672315 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672416 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672617 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672703 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.672938 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673028 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673243 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673342 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673550 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673636 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673853 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.673939 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.674154 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.674242 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.674453 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.674539 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.674758 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.674853 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.675072 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.675172 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.675377 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.675471 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.676219 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.676311 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.676532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.676619 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.676843 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.676981 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.677166 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.677263 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.677478 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.677571 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.677779 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.677865 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678076 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678171 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678374 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678461 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678671 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678757 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.678983 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679075 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679299 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679392 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679641 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679737 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679899 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.679996 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.680201 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.680295 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.680504 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.680599 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.680810 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.680905 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.681138 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.681233 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.681442 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.681529 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.681759 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.681854 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682067 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682160 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682367 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682461 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682669 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682763 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.682971 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683057 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683272 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683367 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683574 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683660 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683881 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.683974 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.684181 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.684267 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.684485 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.684572 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.684792 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.684877 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.685113 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.685213 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.685418 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.685504 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.685729 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.685815 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.686059 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.686286 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.686382 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.686615 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.686707 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.686923 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687010 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687233 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687320 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687544 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687635 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687856 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.687942 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.688171 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.688257 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.688483 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.688575 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.688794 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.688895 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.689118 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.689218 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.689422 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.689508 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.689721 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.689807 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690021 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690116 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690325 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690418 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690621 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690706 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.690919 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.691007 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.691276 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692052 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692140 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692374 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692469 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692674 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692760 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.692998 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.693102 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.693303 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.693399 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.693613 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.693700 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.693913 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694049 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694221 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694322 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694522 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694608 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694848 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.694948 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.695152 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.695239 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.695452 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.695539 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.695751 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.695845 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.696050 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.696144 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.696380 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.696466 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.696679 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.696772 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697007 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697108 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697329 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697425 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697637 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697723 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.697942 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698038 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698248 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698336 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698555 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698648 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698855 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.698953 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.699156 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.699250 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.699455 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.699543 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.699759 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.699852 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700059 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700151 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700357 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700445 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700663 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700759 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.700987 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701077 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701293 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701392 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701598 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701686 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701895 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.701981 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.702201 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.702286 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.702504 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.702591 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.702813 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.702898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.703118 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.703212 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.703420 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.703564 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.703721 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.703892 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704026 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704199 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704329 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704504 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704627 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704811 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.704978 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.705148 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.705256 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.705458 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.705568 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.705763 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.705870 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.706075 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.706162 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.706386 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.706472 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.706696 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.706795 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.707073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.707239 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.707387 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.707735 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.707824 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.708042 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.708220 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.708360 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.708671 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.708756 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709001 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709184 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709309 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709507 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709622 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709818 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.709970 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.710124 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.710212 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.710428 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.710513 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.710735 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.710834 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711058 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711145 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711370 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711456 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711672 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711768 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.711978 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.712065 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.712279 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.712364 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.712581 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.712677 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.712881 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713009 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713208 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713295 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713507 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713615 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713808 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.713895 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.714105 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.714192 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.714405 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.714508 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.714708 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.714811 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715014 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715149 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715316 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715403 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715615 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715701 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.715916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716001 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716214 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716309 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716524 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716608 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716829 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.716943 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.717168 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.717257 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.717476 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.717562 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.717783 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.717883 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.718087 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.718174 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.718390 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.718483 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.718694 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.718957 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719274 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719361 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719583 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719669 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719887 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.719974 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.720197 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.720300 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.720496 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.720582 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.720794 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.720889 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.721121 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.721219 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.721430 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.721516 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.721735 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.721823 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.722052 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.722146 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.722371 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.722467 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.722729 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.722813 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723049 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723134 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723364 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723458 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723668 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723753 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.723973 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724060 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724277 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724417 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724580 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724666 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724888 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.724996 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.725217 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.725317 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.725524 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.725610 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.725829 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.725924 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.726132 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.726220 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.726431 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.726524 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.726735 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.726823 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727037 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727125 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727339 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727426 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727660 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727746 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.727966 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.728054 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.728266 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.728351 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.728621 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.728751 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.728953 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.729071 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.729253 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.729392 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.729557 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.729813 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.730041 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.730254 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.730405 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.730548 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.730696 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.730853 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731004 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731146 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731289 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731428 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731567 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731729 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.731875 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732021 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732178 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732323 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732466 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732622 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732767 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.732966 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.733115 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.733258 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.733418 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.733573 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.733719 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.733865 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734002 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734148 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734309 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734454 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734602 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734761 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.734905 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735051 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735210 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735421 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735569 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735714 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735855 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.735992 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.736155 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.736358 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.736554 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.736741 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.737057 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.737266 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.737499 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.737664 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.737808 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.737963 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.738606 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.738606 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.738904 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739052 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739197 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739352 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739498 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739657 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739796 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.739936 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.740083 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.740225 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.740369 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.740536 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.740681 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.740837 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741021 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741167 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741326 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741484 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741629 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741775 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.741914 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742059 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742223 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742365 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742509 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742650 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742793 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.742954 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.743112 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.743283 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.743472 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.743617 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.743760 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.743913 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.744091 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.744244 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.744408 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.744548 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.744710 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.744860 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.745094 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.745188 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.745420 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.745681 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.745838 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.745987 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746134 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746292 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746390 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746590 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746679 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746889 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.746975 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.747204 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.747292 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.747504 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.747591 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.747808 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.747902 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.748114 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.748201 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.748416 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.748511 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.748715 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.748830 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.749035 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.749185 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.749352 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.749505 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.749952 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750084 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750175 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750255 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750330 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750551 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750644 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750864 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.750957 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.751162 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.751255 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.751481 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.751567 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.751788 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.751876 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.752087 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.752176 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.752388 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.752474 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.752687 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.752775 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.753018 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.753119 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.753333 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.753427 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.753643 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.753729 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.754515 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.754610 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.754835 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.754941 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.755138 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.755224 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.755446 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.755579 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.755756 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.755853 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.756081 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.756175 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.756389 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.756476 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.756707 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.756802 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757031 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757120 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757333 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757419 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757637 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757726 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.757936 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758031 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758235 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758321 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758534 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758633 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758836 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.758930 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.759134 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.759228 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.759432 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.759520 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.759729 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.759816 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760047 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760132 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760346 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760472 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760663 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760757 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.760985 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.761094 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.761287 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.761382 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.761586 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.761680 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.761884 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762012 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762222 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762336 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762522 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762658 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762851 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.762988 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.763168 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.763291 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.763485 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.763577 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.763809 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.763910 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.764115 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.764204 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.764434 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.764536 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.764748 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.764849 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.765081 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.765169 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.765399 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.765486 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.765706 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.765844 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766013 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766147 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766321 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766453 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766630 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766767 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.766933 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767075 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767242 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767374 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767551 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767694 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767859 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.767990 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.768162 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.768397 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.768542 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.768720 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.768852 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.769053 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.769145 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.769387 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.769479 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.769700 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.769795 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770009 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770096 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770317 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770407 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770624 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770720 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.770926 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771024 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771231 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771327 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771534 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771630 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771853 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.771950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.772174 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.772287 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.772497 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.772594 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.772826 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.772961 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.773162 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.773306 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.773469 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.773558 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.773776 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.773881 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.774084 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.774172 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.774436 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.774628 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.774744 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.774962 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.775100 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.775278 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.775410 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.775593 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.775693 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.775907 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.776039 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.776223 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.776353 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.776525 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.776662 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.776831 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777018 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777160 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777248 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777466 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777557 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777768 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.777855 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.778072 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.778159 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.778377 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.778466 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.778694 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.778782 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779021 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779119 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779333 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779421 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779640 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779739 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.779946 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.780046 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.780253 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.780340 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.780608 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.780762 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.780942 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.781109 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.781260 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.781443 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.781576 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.781768 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.781895 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.782092 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.782210 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.782407 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.782521 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.782720 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.782836 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783139 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783349 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783444 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783651 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783747 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.783960 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.784055 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.784267 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.784355 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.784569 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.784666 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.784886 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.785574 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.785808 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.785898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.786114 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.786203 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.786432 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.786520 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.786739 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.786825 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.787060 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.787262 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.787586 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.787673 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.787908 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.787994 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.788231 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.788327 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.788555 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.788649 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.788868 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.788988 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.789196 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.789285 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.789518 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.789605 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.789822 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.789918 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.790124 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.790211 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.790433 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.790521 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.790738 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.790833 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.791036 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.791123 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.791341 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.791472 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.791647 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792011 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792204 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792303 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792502 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792609 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792806 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.792905 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.793131 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.793230 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.793451 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.793662 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.793763 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794015 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794103 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794324 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794410 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794628 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794726 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.794927 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795015 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795229 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795338 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795533 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795631 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795832 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.795934 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.796137 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.796233 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.796437 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.796527 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.796740 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.796836 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797062 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797155 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797368 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797466 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797668 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797764 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.797971 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.798067 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.798298 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.798386 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.798608 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.798694 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.798914 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799044 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799216 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799306 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799524 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799618 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799828 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.799924 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.800132 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.800218 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.800439 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.800525 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.800802 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.801406 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.801647 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.801758 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.801957 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.802045 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.802274 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.802479 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.802581 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.802808 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.802906 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.803125 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.803215 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.803469 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.803556 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.803771 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.803866 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.804069 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.804166 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.804369 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.804457 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.804668 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.804763 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805007 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805113 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805318 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805423 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805631 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805720 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.805937 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806032 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806244 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806342 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806548 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806638 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806852 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.806942 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.807153 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.807241 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.807459 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.807547 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.807763 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.807852 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.808066 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.808156 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.808370 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.808637 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.808737 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.808981 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.809071 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.809291 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.809381 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.809627 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.809729 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.809941 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.810029 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.810253 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.810338 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.810562 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.810659 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.810870 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.811102 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.811197 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.811433 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.811532 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.811751 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.811855 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.812051 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.812138 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.812360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.812458 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.812673 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.812759 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813004 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813095 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813307 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813405 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813617 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813711 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.813931 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814019 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814243 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814332 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814553 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814696 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814865 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.814955 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.815176 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.815267 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.815486 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.815578 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.815800 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.815899 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.816125 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.816222 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.816467 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.816556 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.816787 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.816883 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.817137 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.817226 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.817457 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.817545 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.817773 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.817874 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818074 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818164 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818375 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818472 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818675 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818772 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.818979 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.819068 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.819291 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.819378 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.819594 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.819861 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.819948 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.820177 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.820265 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.820480 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.820602 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.820776 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.820950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821097 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821254 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821396 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821574 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821693 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821889 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.821977 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.822214 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.822310 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.822539 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.822626 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.822843 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.822930 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.823139 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.823236 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.823437 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.823531 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.823733 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.823828 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824032 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824129 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824327 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824424 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824623 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824710 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.824919 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825050 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825235 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825360 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825536 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825663 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825861 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.825959 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.826188 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.826320 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.826497 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.826585 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.826815 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.826912 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.827119 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.827206 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.827436 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.827523 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.827739 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.827837 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.828042 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.828141 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.828348 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.828446 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.828653 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.828742 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829024 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829121 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829284 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829381 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829588 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829676 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.829908 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830050 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830192 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830344 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830491 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830579 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830793 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.830880 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.831095 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.831193 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.831397 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.831492 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.831703 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.831791 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832032 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832130 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832336 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832424 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832639 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832739 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.832972 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.833062 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.833286 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.833375 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.833591 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.833680 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.833915 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834012 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834219 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834307 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834524 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834621 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834826 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.834914 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.835130 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.835225 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.835436 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.835533 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.835746 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.835843 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836048 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836136 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836354 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836451 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836758 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.836994 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.837088 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.837320 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.837430 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.837630 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.837721 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.837933 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838019 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838339 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838565 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838652 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838891 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.838987 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.839196 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.839291 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.839521 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.839608 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.839842 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.839938 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.840150 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.840238 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.840456 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.840551 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.840756 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.840853 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.841017 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103285) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:05:11.841119 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.841420 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.841733 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.842046 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.842362 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.842675 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.842993 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.843306 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.843619 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.843937 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.844256 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.844586 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.844916 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.845250 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.845579 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.845912 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.846256 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.846572 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.846925 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.847255 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.848109 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.848421 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.848730 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:05:11.848999 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103284) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:05:11.903312 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Registered counter for database nova_api Jul 14 10:05:11.912689 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Registered counter for database nova_api Jul 14 10:05:12.016955 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.023365 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.023617 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.029723 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.079006 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.context [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1ffe045-142f-4ef4-ace8-4e9048e3e1e9(cell1) {{(pid=103285) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:05:12.083026 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:12.084530 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:12.085356 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:12.087272 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.context [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1ffe045-142f-4ef4-ace8-4e9048e3e1e9(cell1) {{(pid=103284) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:05:12.087446 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:12.089420 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Registered counter for database nova_cell0 Jul 14 10:05:12.091197 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:12.092779 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:12.093264 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Registered counter for database nova_cell1 Jul 14 10:05:12.093591 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:05:12.095694 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_concurrency.lockutils [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103284) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:05:12.100338 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Registered counter for database nova_cell0 Jul 14 10:05:12.101072 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.102227 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Registered counter for database nova_cell1 Jul 14 10:05:12.103180 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.108110 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.111441 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.112704 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.113207 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.119641 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.121709 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.255129 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO dbcounter [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Registered counter for database nova_cell0 Jul 14 10:05:12.263768 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_db.sqlalchemy.engines [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103285) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.268164 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writer thread running {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.268501 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO dbcounter [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Registered counter for database nova_cell0 Jul 14 10:05:12.275800 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG oslo_db.sqlalchemy.engines [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103284) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:05:12.280005 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writer thread running {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:05:12.603246 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:05:12.608391 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:05:12.610584 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:05:12.616232 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:05:12.950013 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:05:12.955453 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:05:12.956050 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: WARNING keystonemiddleware.auth_token [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:05:12.961161 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560091e869c0 pid: 103285 (default app) Jul 14 10:05:12.961377 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: WARNING keystonemiddleware.auth_token [None req-cee1e14e-4dd9-4bac-8907-0bb221121cd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:05:12.963173 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:05:12.964368 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jul 14 10:05:12.964776 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Thu Jul 14 10:05:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:05:12.966617 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560091e869c0 pid: 103284 (default app) Jul 14 10:06:28.545408 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:28.546433 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 14 10:06:28.547497 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:28.563587 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:28.564813 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_cell1:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:28.565775 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_cell0:SELECT=3 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:28.566623 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:29.422339 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-c7ec6629-b5fd-4867-a8ee-881bd197b0ea admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:29.452720 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-c7ec6629-b5fd-4867-a8ee-881bd197b0ea admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.898186 Jul 14 10:06:29.465005 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jul 14 10:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:31.690634 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:31.691525 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e7a6a9a7-a210-4003-b4cb-2c00d826db5c None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Jul 14 10:06:31.692106 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:32.171280 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-74f459be-c561-44a8-a4b7-e2c3824037b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "vcpus": 1}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:32.190431 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:06:32.190431 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: warnings.warn(msg) Jul 14 10:06:32.219057 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-74f459be-c561-44a8-a4b7-e2c3824037b6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.520973 Jul 14 10:06:32.219704 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:06:32.233797 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=3 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:32.234872 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell1:SELECT=3 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:32.236204 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell0:SELECT=3 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:32.237372 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:32.457106 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-d2114ffb-ca91-489f-a6c3-f97c5b1ff022 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:32.459545 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:06:32.459545 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 14 10:06:32.522886 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-d2114ffb-ca91-489f-a6c3-f97c5b1ff022 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294888 Jul 14 10:06:32.523474 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jul 14 10:06:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:34.787181 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-74f459be-c561-44a8-a4b7-e2c3824037b6 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:34.788199 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-74f459be-c561-44a8-a4b7-e2c3824037b6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 14 10:06:34.789075 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:35.445385 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4ef0b970-7d2f-4f9e-8107-e7661f297e45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "ram": 512, "id": "d1"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:35.464282 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:06:35.464282 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 14 10:06:35.488588 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-4ef0b970-7d2f-4f9e-8107-e7661f297e45 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693937 Jul 14 10:06:35.496835 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:35.503602 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f7df2e89-401e-4eaa-8bd4-ccd59d5bca95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:35.505320 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:06:35.505320 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: warnings.warn(msg) Jul 14 10:06:35.547892 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f7df2e89-401e-4eaa-8bd4-ccd59d5bca95 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048592 Jul 14 10:06:35.548481 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jul 14 10:06:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:37.767951 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4ef0b970-7d2f-4f9e-8107-e7661f297e45 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:37.769327 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-4ef0b970-7d2f-4f9e-8107-e7661f297e45 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 14 10:06:37.769631 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:06:38.139540 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-d1132c06-73e3-440a-8e07-040cdc090b2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds1G", "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:38.157299 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-d1132c06-73e3-440a-8e07-040cdc090b2f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.382157 Jul 14 10:06:38.157942 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:06:38.169862 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-21aa469a-942a-41bd-aaa7-89d5cc547b33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:38.192448 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-21aa469a-942a-41bd-aaa7-89d5cc547b33 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026272 Jul 14 10:06:38.193076 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jul 14 10:06:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:40.397643 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-d1132c06-73e3-440a-8e07-040cdc090b2f admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:40.398704 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-d1132c06-73e3-440a-8e07-040cdc090b2f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jul 14 10:06:40.399183 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:40.827513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-fba9c222-18c4-42ee-ad33-90af3cd1828b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "id": "d3"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:40.844428 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-fba9c222-18c4-42ee-ad33-90af3cd1828b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439104 Jul 14 10:06:40.845101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:40.856742 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-4724fd38-4517-418f-90b9-1a1205b24f22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:40.879649 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-4724fd38-4517-418f-90b9-1a1205b24f22 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026603 Jul 14 10:06:40.880213 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jul 14 10:06:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:43.113806 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-fba9c222-18c4-42ee-ad33-90af3cd1828b admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:43.114841 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-fba9c222-18c4-42ee-ad33-90af3cd1828b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jul 14 10:06:43.115270 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:43.532420 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-05993608-198e-4695-96cc-a64c2e3047e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:43.551485 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-05993608-198e-4695-96cc-a64c2e3047e3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429530 Jul 14 10:06:43.552215 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:43.564363 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-f13a9a72-b99f-49c4-9417-709503104ad9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:43.587415 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-f13a9a72-b99f-49c4-9417-709503104ad9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026941 Jul 14 10:06:43.588036 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Thu Jul 14 10:06:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:45.812231 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-05993608-198e-4695-96cc-a64c2e3047e3 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:45.813333 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-05993608-198e-4695-96cc-a64c2e3047e3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 14 10:06:45.813700 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:46.228908 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-319a574c-9ef1-465d-9171-5965f941d8a5 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:46.253124 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-319a574c-9ef1-465d-9171-5965f941d8a5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433220 Jul 14 10:06:46.253750 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jul 14 10:06:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:06:48.475015 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-05993608-198e-4695-96cc-a64c2e3047e3 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:48.476031 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-05993608-198e-4695-96cc-a64c2e3047e3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 14 10:06:48.476431 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:48.957574 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e72b6e8f-5035-47eb-99a8-2b9f0780fc7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "disk": 1, "swap": 0}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:48.975365 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e72b6e8f-5035-47eb-99a8-2b9f0780fc7c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491694 Jul 14 10:06:48.975930 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:48.991153 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-54c847b2-e48e-4617-82af-d04af83d6033 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:49.021866 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-54c847b2-e48e-4617-82af-d04af83d6033 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034880 Jul 14 10:06:49.022624 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jul 14 10:06:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:51.258631 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e72b6e8f-5035-47eb-99a8-2b9f0780fc7c admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:51.259657 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e72b6e8f-5035-47eb-99a8-2b9f0780fc7c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 14 10:06:51.260068 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:51.652628 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3da09359-cf7d-4ea3-8af1-bcb60d2da22a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:51.671008 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3da09359-cf7d-4ea3-8af1-bcb60d2da22a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.404234 Jul 14 10:06:51.671512 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:06:51.683227 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-53617e24-c94e-4d9f-928f-0d18eaefe544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:51.706002 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-53617e24-c94e-4d9f-928f-0d18eaefe544 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026415 Jul 14 10:06:51.706572 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jul 14 10:06:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:53.915365 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3da09359-cf7d-4ea3-8af1-bcb60d2da22a admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:53.916391 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3da09359-cf7d-4ea3-8af1-bcb60d2da22a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 14 10:06:53.916834 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:54.331645 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-da165fe8-c7ba-43f9-8d07-8f6621523db6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:54.354821 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-da165fe8-c7ba-43f9-8d07-8f6621523db6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430943 Jul 14 10:06:54.355740 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:54.367944 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-70706899-25f1-449e-b7cd-f05a0e4a512c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:54.392358 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-70706899-25f1-449e-b7cd-f05a0e4a512c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028038 Jul 14 10:06:54.392955 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jul 14 10:06:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:06:56.676634 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-da165fe8-c7ba-43f9-8d07-8f6621523db6 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:56.677839 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-da165fe8-c7ba-43f9-8d07-8f6621523db6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 Jul 14 10:06:56.678250 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:57.142601 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-698225bd-ddce-4650-aaf6-42948f655adc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:57.165523 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-698225bd-ddce-4650-aaf6-42948f655adc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481342 Jul 14 10:06:57.166076 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:57.179323 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-610459da-3d37-447c-9d11-677770b55d1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:57.205817 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-610459da-3d37-447c-9d11-677770b55d1e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030146 Jul 14 10:06:57.206506 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jul 14 10:06:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:06:59.489299 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-698225bd-ddce-4650-aaf6-42948f655adc admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:06:59.490314 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-698225bd-ddce-4650-aaf6-42948f655adc admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 14 10:06:59.490716 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:06:59.931011 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-cc3b0c95-5751-43a4-8050-82c5a38007d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:59.950579 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-cc3b0c95-5751-43a4-8050-82c5a38007d9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454244 Jul 14 10:06:59.951121 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Thu Jul 14 10:06:59 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:06:59.963635 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-8f8f41f4-ddf9-4cf6-b9bb-43c2444d0c89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:06:59.967405 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:06:59.990977 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-8f8f41f4-ddf9-4cf6-b9bb-43c2444d0c89 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031108 Jul 14 10:06:59.991836 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Thu Jul 14 10:06:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:07:19.738891 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-cc3b0c95-5751-43a4-8050-82c5a38007d9 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:19.739922 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-cc3b0c95-5751-43a4-8050-82c5a38007d9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 14 10:07:19.740323 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:07:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:19.750927 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:20.121822 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-3fd1c656-d4c3-4eb3-b2ce-8ce34312d5ae admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:20.139300 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-3fd1c656-d4c3-4eb3-b2ce-8ce34312d5ae admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.392523 Jul 14 10:07:20.139819 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jul 14 10:07:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:07:21.313993 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-cc3b0c95-5751-43a4-8050-82c5a38007d9 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:21.315023 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-cc3b0c95-5751-43a4-8050-82c5a38007d9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 14 10:07:21.315439 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:21.838962 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-4fee35ef-09de-4fdf-9896-6f9e30d25021 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:21.844465 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.wsgi [None req-4fee35ef-09de-4fdf-9896-6f9e30d25021 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-4fee35ef-09de-4fdf-9896-6f9e30d25021 admin admin] Request method failure captured: Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Accept: application/json Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Accept-Encoding: gzip, deflate Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Connection: keep-alive Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Content-Length: 0 Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Host: 10.222.0.61 Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Openstack-Api-Version: compute 2.90 Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Openstack-System-Scope: None Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: User-Agent: python-novaclient Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Auth-Token: gAAAAABiz-rZwwmzHrSCyX6bWmHpooysAAXwfv_EB99-feYn1j2pM50I92mesLytetP74xZFRyQMSeFyECey8AjCuqg9ES4wV8W5HYCmYntwAEppNxj-PUksdSLlyGOZJLcq1NqfZrKDf092GKaaFjQkSRNUWfpyT_VuM5B3a75E10kvM9ddIg0 Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Domain-Id: None Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Domain-Name: None Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Identity-Status: Confirmed Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Is-Admin-Project: True Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Domain-Id: default Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Domain-Name: Default Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Name: admin Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Role: reader,admin,member Jul 14 10:07:21.848235 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Roles: reader,admin,member Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4677fbdc96dd49fca8554ea63b0d5a7c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant: admin Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant-Name: admin Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User: admin Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Domain-Id: default Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Domain-Name: Default Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Id: e054eebdda2a494f804b604ef19ea604 Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Name: admin Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: method: > Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: exception: Flavor 42 could not be found. Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: action_args: {'id': '42'} Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:07:21.849880 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:21.850867 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.852073 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-4fee35ef-09de-4fdf-9896-6f9e30d25021 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:07:21.853145 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-4fee35ef-09de-4fdf-9896-6f9e30d25021 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393854 Jul 14 10:07:21.853145 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jul 14 10:07:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:21.859899 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-ff30c59c-10ef-4dfd-be73-a0cefc6043e2 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:21.862857 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:07:21.883096 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-ff30c59c-10ef-4dfd-be73-a0cefc6043e2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027341 Jul 14 10:07:21.883636 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jul 14 10:07:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:21.893531 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-c4c08a72-0dff-4227-8363-533ff5e4ac0c admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:21.915371 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-c4c08a72-0dff-4227-8363-533ff5e4ac0c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025678 Jul 14 10:07:21.915928 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jul 14 10:07:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:21.926590 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-22bcebfc-89da-4664-909c-31f633f0a693 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:21.933154 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.wsgi [None req-22bcebfc-89da-4664-909c-31f633f0a693 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-22bcebfc-89da-4664-909c-31f633f0a693 admin admin] Request method failure captured: Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Accept: application/json Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Accept-Encoding: gzip, deflate Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Connection: keep-alive Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Content-Length: 0 Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Host: 10.222.0.61 Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Openstack-Api-Version: compute 2.90 Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Openstack-System-Scope: None Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: User-Agent: python-novaclient Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Auth-Token: gAAAAABiz-rZwwmzHrSCyX6bWmHpooysAAXwfv_EB99-feYn1j2pM50I92mesLytetP74xZFRyQMSeFyECey8AjCuqg9ES4wV8W5HYCmYntwAEppNxj-PUksdSLlyGOZJLcq1NqfZrKDf092GKaaFjQkSRNUWfpyT_VuM5B3a75E10kvM9ddIg0 Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Domain-Id: None Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Domain-Name: None Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Identity-Status: Confirmed Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Is-Admin-Project: True Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Domain-Id: default Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Domain-Name: Default Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Name: admin Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Role: reader,admin,member Jul 14 10:07:21.937045 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Roles: reader,admin,member Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4677fbdc96dd49fca8554ea63b0d5a7c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant: admin Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant-Name: admin Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User: admin Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Domain-Id: default Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Domain-Name: Default Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Id: e054eebdda2a494f804b604ef19ea604 Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Name: admin Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: method: > Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: exception: Flavor 42 could not be found. Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: action_args: {'id': '42'} Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:07:21.938513 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:21.939463 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:21.940662 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-22bcebfc-89da-4664-909c-31f633f0a693 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:07:21.941685 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-22bcebfc-89da-4664-909c-31f633f0a693 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016310 Jul 14 10:07:21.941685 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jul 14 10:07:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:22.906318 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-c4c08a72-0dff-4227-8363-533ff5e4ac0c admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:22.907457 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-c4c08a72-0dff-4227-8363-533ff5e4ac0c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 14 10:07:22.907883 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:23.426388 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4146a30c-7faa-4969-ad1a-b2a49b451dcb admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:23.431794 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.wsgi [None req-4146a30c-7faa-4969-ad1a-b2a49b451dcb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4146a30c-7faa-4969-ad1a-b2a49b451dcb admin admin] Request method failure captured: Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Accept: application/json Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Accept-Encoding: gzip, deflate Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Connection: keep-alive Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Content-Length: 0 Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Host: 10.222.0.61 Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Openstack-Api-Version: compute 2.90 Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Openstack-System-Scope: None Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: User-Agent: python-novaclient Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Auth-Token: gAAAAABiz-rad-dsNPLd7TqJI2Bhj4rmig3OjjtTagR4t_2e5ICXiVFN5lKTHgXUDVXvSvTc1nNNCjjBw-uaoCRL9OSRefuHPL_Xwc9mo_2pq47glRQdtmjEfoUUZZOQgXC2hdS9pP5-PAso3Z7kE_7UD2G6P0nLmE6ezTkuKa4Wn6hUcOOILlA Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Domain-Id: None Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Domain-Name: None Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Identity-Status: Confirmed Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Is-Admin-Project: True Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Domain-Id: default Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Domain-Name: Default Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Name: admin Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Role: reader,admin,member Jul 14 10:07:23.433360 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Roles: reader,admin,member Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4677fbdc96dd49fca8554ea63b0d5a7c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant: admin Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant-Name: admin Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User: admin Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Domain-Id: default Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Domain-Name: Default Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Id: e054eebdda2a494f804b604ef19ea604 Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Name: admin Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: method: > Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: exception: Flavor 84 could not be found. Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: action_args: {'id': '84'} Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:07:23.434916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:23.437101 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.438406 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-4146a30c-7faa-4969-ad1a-b2a49b451dcb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:07:23.439613 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-4146a30c-7faa-4969-ad1a-b2a49b451dcb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386483 Jul 14 10:07:23.439613 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jul 14 10:07:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:23.444571 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-db1b07cf-88d4-49ef-89c4-a16f45347879 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:23.458614 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-db1b07cf-88d4-49ef-89c4-a16f45347879 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017657 Jul 14 10:07:23.459133 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jul 14 10:07:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:23.469025 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-cb33998a-3300-4f6d-943f-f4e38e5d94a2 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:23.482705 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-cb33998a-3300-4f6d-943f-f4e38e5d94a2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017760 Jul 14 10:07:23.483226 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jul 14 10:07:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:07:23.492210 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-16a8bdfd-0ee4-4da0-b4f1-815cbeccc9b9 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:23.497435 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.wsgi [None req-16a8bdfd-0ee4-4da0-b4f1-815cbeccc9b9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-16a8bdfd-0ee4-4da0-b4f1-815cbeccc9b9 admin admin] Request method failure captured: Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Accept: application/json Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Accept-Encoding: gzip, deflate Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Connection: keep-alive Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Content-Length: 0 Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Host: 10.222.0.61 Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Openstack-Api-Version: compute 2.90 Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Openstack-System-Scope: None Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: User-Agent: python-novaclient Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Auth-Token: gAAAAABiz-rad-dsNPLd7TqJI2Bhj4rmig3OjjtTagR4t_2e5ICXiVFN5lKTHgXUDVXvSvTc1nNNCjjBw-uaoCRL9OSRefuHPL_Xwc9mo_2pq47glRQdtmjEfoUUZZOQgXC2hdS9pP5-PAso3Z7kE_7UD2G6P0nLmE6ezTkuKa4Wn6hUcOOILlA Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Domain-Id: None Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Domain-Name: None Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Identity-Status: Confirmed Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Is-Admin-Project: True Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Domain-Id: default Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Domain-Name: Default Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Name: admin Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Role: reader,admin,member Jul 14 10:07:23.498950 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Roles: reader,admin,member Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4677fbdc96dd49fca8554ea63b0d5a7c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant: admin Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant-Name: admin Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User: admin Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Domain-Id: default Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Domain-Name: Default Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Id: e054eebdda2a494f804b604ef19ea604 Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Name: admin Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: method: > Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: exception: Flavor 84 could not be found. Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: action_args: {'id': '84'} Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:07:23.500532 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:23.501514 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:23.502898 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-16a8bdfd-0ee4-4da0-b4f1-815cbeccc9b9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:07:23.504156 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-16a8bdfd-0ee4-4da0-b4f1-815cbeccc9b9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011498 Jul 14 10:07:23.504156 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Jul 14 10:07:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:24.461790 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-cb33998a-3300-4f6d-943f-f4e38e5d94a2 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:24.462797 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-cb33998a-3300-4f6d-943f-f4e38e5d94a2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 10:07:24.463198 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:24.977160 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-6215cb5e-01c1-4d60-a143-e323173c949e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:24.983468 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.wsgi [None req-6215cb5e-01c1-4d60-a143-e323173c949e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-6215cb5e-01c1-4d60-a143-e323173c949e admin admin] Request method failure captured: Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Accept: application/json Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Accept-Encoding: gzip, deflate Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Connection: keep-alive Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Content-Length: 0 Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Host: 10.222.0.61 Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Openstack-Api-Version: compute 2.90 Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Openstack-System-Scope: None Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: User-Agent: python-novaclient Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Auth-Token: gAAAAABiz-rcwNpeJMUnfgE_0D_IUJ7WDKxAXfoS09QROJ7MflGa1fULF3TWFJFwsFDY7DUCLLPxSEr1IVQKuBqfrF9fqY4Np3a0G5QemfCXtl1roq2NaCEAmIFCPFc_DgRpNJWj5iO1isJamZ51lvD2ZNlaxiXV4gu8yVNiiplJ1R6LaLFSrFQ Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Domain-Id: None Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Domain-Name: None Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Identity-Status: Confirmed Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Is-Admin-Project: True Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Domain-Id: default Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Domain-Name: Default Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Project-Name: admin Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Role: reader,admin,member Jul 14 10:07:24.985004 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Roles: reader,admin,member Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4677fbdc96dd49fca8554ea63b0d5a7c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant: admin Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-Tenant-Name: admin Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User: admin Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Domain-Id: default Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Domain-Name: Default Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Id: e054eebdda2a494f804b604ef19ea604 Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: X-User-Name: admin Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: method: > Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: exception: Flavor 451 could not be found. Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: action_args: {'id': '451'} Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:07:24.986632 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:24.987698 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: ERROR nova.api.openstack.wsgi Jul 14 10:07:24.989245 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-6215cb5e-01c1-4d60-a143-e323173c949e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103284) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:07:24.990521 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-6215cb5e-01c1-4d60-a143-e323173c949e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.385759 Jul 14 10:07:24.990521 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jul 14 10:07:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:24.999265 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-a6d57990-b9b2-4e4c-9923-48333cb57647 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:25.014480 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-a6d57990-b9b2-4e4c-9923-48333cb57647 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021736 Jul 14 10:07:25.015018 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jul 14 10:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:07:25.025562 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:25.040863 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019688 Jul 14 10:07:25.041427 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Jul 14 10:07:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:07:25.054097 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-82e124c2-4e90-442b-a183-0bc4bf1291b3 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:25.059615 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.wsgi [None req-82e124c2-4e90-442b-a183-0bc4bf1291b3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-82e124c2-4e90-442b-a183-0bc4bf1291b3 admin admin] Request method failure captured: Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Accept: application/json Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Accept-Encoding: gzip, deflate Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Connection: keep-alive Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Content-Length: 0 Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Host: 10.222.0.61 Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Openstack-Api-Version: compute 2.90 Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Openstack-System-Scope: None Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: User-Agent: python-novaclient Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Auth-Token: gAAAAABiz-rcwNpeJMUnfgE_0D_IUJ7WDKxAXfoS09QROJ7MflGa1fULF3TWFJFwsFDY7DUCLLPxSEr1IVQKuBqfrF9fqY4Np3a0G5QemfCXtl1roq2NaCEAmIFCPFc_DgRpNJWj5iO1isJamZ51lvD2ZNlaxiXV4gu8yVNiiplJ1R6LaLFSrFQ Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Domain-Id: None Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Domain-Name: None Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Identity-Status: Confirmed Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Is-Admin-Project: True Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Domain-Id: default Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Domain-Name: Default Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Project-Name: admin Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Role: reader,admin,member Jul 14 10:07:25.061834 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Roles: reader,admin,member Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4677fbdc96dd49fca8554ea63b0d5a7c", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4677fbdc96dd49fca8554ea63b0d5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant: admin Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant-Id: 4677fbdc96dd49fca8554ea63b0d5a7c Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-Tenant-Name: admin Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User: admin Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Domain-Id: default Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Domain-Name: Default Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Id: e054eebdda2a494f804b604ef19ea604 Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: X-User-Name: admin Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: method: > Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: exception: Flavor 451 could not be found. Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: action_args: {'id': '451'} Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:07:25.063478 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:25.064379 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: ERROR nova.api.openstack.wsgi Jul 14 10:07:25.065616 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-82e124c2-4e90-442b-a183-0bc4bf1291b3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103285) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:07:25.066658 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-82e124c2-4e90-442b-a183-0bc4bf1291b3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012719 Jul 14 10:07:25.066658 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jul 14 10:07:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 10:07:26.041329 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:26.042339 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 14 10:07:26.042733 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:26.568992 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-2a5e60d5-277a-474a-855d-0f99aa4c153e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:07:26.586750 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-2a5e60d5-277a-474a-855d-0f99aa4c153e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.395619 Jul 14 10:07:26.587292 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jul 14 10:07:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:07:27.559562 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:27.560570 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jul 14 10:07:27.560982 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:28.083476 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e1914cbc-1c7f-42f1-9e17-75f7f1371403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:07:28.100262 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e1914cbc-1c7f-42f1-9e17-75f7f1371403 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402781 Jul 14 10:07:28.100806 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jul 14 10:07:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:07:29.074169 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:29.075225 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 14 10:07:29.075615 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:29.594016 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-1322f4b3-af0f-44e7-a27e-d751a824beb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:07:29.611259 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-1322f4b3-af0f-44e7-a27e-d751a824beb7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.395428 Jul 14 10:07:29.611796 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jul 14 10:07:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:07:30.583164 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:30.584172 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 14 10:07:30.584568 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:31.119785 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-268e4b71-7045-4c9d-91cb-96f51dedf003 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:07:31.138438 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-268e4b71-7045-4c9d-91cb-96f51dedf003 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.413759 Jul 14 10:07:31.138974 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Jul 14 10:07:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:07:32.110587 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:32.111597 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 14 10:07:32.111990 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:07:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:07:32.628523 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-8fb8a4a3-bfc7-4d32-b6d0-54cf92b7c2f0 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:07:32.647230 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-8fb8a4a3-bfc7-4d32-b6d0-54cf92b7c2f0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.396572 Jul 14 10:07:32.647766 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Thu Jul 14 10:07:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:24.010342 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.011351 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-f0ce3352-47ea-4b62-9b0c-bb4f5498d68e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Jul 14 10:08:24.011744 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:08:24.022329 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:24.400764 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-50ba29b0-5373-4dee-af68-1028c484cd73 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.421321 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-50ba29b0-5373-4dee-af68-1028c484cd73 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403383 Jul 14 10:08:24.421922 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:08:24.444981 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-a6442b80-80e5-48a4-b096-234a3c943017 admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.448360 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG dbcounter [-] [103284] Writing DB stats nova_api:SELECT=14 {{(pid=103284) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:08:24.454132 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-a6442b80-80e5-48a4-b096-234a3c943017 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012795 Jul 14 10:08:24.454689 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:24.466323 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-ea650706-c234-42f6-8b74-850849ba830c admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.473913 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-ea650706-c234-42f6-8b74-850849ba830c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011625 Jul 14 10:08:24.474427 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:08:24.486237 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.493765 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011069 Jul 14 10:08:24.494241 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:08:24.504898 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-23ff9da2-da87-4d25-9419-ee63dc253d43 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:08:24.512826 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-23ff9da2-da87-4d25-9419-ee63dc253d43 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011279 Jul 14 10:08:24.513370 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Thu Jul 14 10:08:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:11:43.270695 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:43.271690 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 14 10:11:43.272074 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:11:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:11:43.411419 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=6 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:43.566855 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-195f6f59-94ef-45f0-a843-c2943082158a admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:43.568054 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:11:43.568054 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 14 10:11:43.569277 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-195f6f59-94ef-45f0-a843-c2943082158a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.569719 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-195f6f59-94ef-45f0-a843-c2943082158a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.570527 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-195f6f59-94ef-45f0-a843-c2943082158a admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:43.570980 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-195f6f59-94ef-45f0-a843-c2943082158a admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:43.605257 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-195f6f59-94ef-45f0-a843-c2943082158a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.195203 Jul 14 10:11:43.605814 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jul 14 10:11:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:11:44.454670 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:44.455753 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 14 10:11:44.456135 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:11:44.651640 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-fbb4eaa6-bb97-4fe7-990e-8d545fcc6610 admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:44.652818 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:11:44.652818 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 14 10:11:44.654119 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-fbb4eaa6-bb97-4fe7-990e-8d545fcc6610 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.654569 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-fbb4eaa6-bb97-4fe7-990e-8d545fcc6610 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.655353 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-fbb4eaa6-bb97-4fe7-990e-8d545fcc6610 admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:44.655791 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-fbb4eaa6-bb97-4fe7-990e-8d545fcc6610 admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:44.676042 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-fbb4eaa6-bb97-4fe7-990e-8d545fcc6610 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075496 Jul 14 10:11:44.676598 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jul 14 10:11:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:11:55.890110 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:55.891113 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 14 10:11:55.891503 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:11:56.035891 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell0:SELECT=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:56.036606 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_cell1:SELECT=4 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:56.037238 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG dbcounter [-] [103285] Writing DB stats nova_api:SELECT=8 {{(pid=103285) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:11:56.085544 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-e1ece4da-9eff-4f4c-8257-70c05eaef48b admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:56.086737 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:11:56.086737 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 14 10:11:56.087916 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e1ece4da-9eff-4f4c-8257-70c05eaef48b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.088351 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e1ece4da-9eff-4f4c-8257-70c05eaef48b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.089155 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e1ece4da-9eff-4f4c-8257-70c05eaef48b admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:56.089578 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-e1ece4da-9eff-4f4c-8257-70c05eaef48b admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:56.115018 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-e1ece4da-9eff-4f4c-8257-70c05eaef48b admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083953 Jul 14 10:11:56.115495 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jul 14 10:11:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:11:56.938281 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: DEBUG nova.api.openstack.wsgi [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] Calling method '>' {{(pid=103284) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:56.939327 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: INFO nova.api.openstack.requestlog [None req-fcb96445-7eb7-4721-ad7a-90e4c545192a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 14 10:11:56.939722 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: [pid: 103284|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Jul 14 10:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:11:57.130802 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG nova.api.openstack.wsgi [None req-1b18b650-e806-443e-bddc-88e6d569080c admin admin] Calling method '>' {{(pid=103285) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:11:57.131982 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 10:11:57.131982 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: warnings.warn(msg) Jul 14 10:11:57.133182 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1b18b650-e806-443e-bddc-88e6d569080c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.133615 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1b18b650-e806-443e-bddc-88e6d569080c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.134395 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1b18b650-e806-443e-bddc-88e6d569080c admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:11:57.134813 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: DEBUG oslo_concurrency.lockutils [None req-1b18b650-e806-443e-bddc-88e6d569080c admin admin] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103285) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:11:57.156262 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: INFO nova.api.openstack.requestlog [None req-1b18b650-e806-443e-bddc-88e6d569080c admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077603 Jul 14 10:11:57.156832 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: [pid: 103285|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Jul 14 10:11:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:12:54.961826 dv-cinder-849800-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 10:12:54.962672 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: Thu Jul 14 10:12:54 2022 - graceful shutdown triggered... Jul 14 10:12:54.963175 dv-cinder-849800-1-iscsi devstack@n-api.service[103284]: Gracefully killing worker 1 (pid: 103284)... Jul 14 10:12:54.963607 dv-cinder-849800-1-iscsi devstack@n-api.service[103285]: Gracefully killing worker 2 (pid: 103285)... Jul 14 10:12:55.963839 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: worker 1 buried after 1 seconds Jul 14 10:12:55.963839 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: worker 2 buried after 1 seconds Jul 14 10:12:55.963839 dv-cinder-849800-1-iscsi devstack@n-api.service[103283]: goodbye to uWSGI. Jul 14 10:12:55.965417 dv-cinder-849800-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 10:12:55.966011 dv-cinder-849800-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 10:12:55.968848 dv-cinder-849800-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 10:12:55.978015 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 10:12:55.980584 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 10:12:55 2022] *** Jul 14 10:12:55.980751 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 10:12:55.980890 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 10:12:55.981173 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: nodename: dv-cinder-849800-1-iscsi Jul 14 10:12:55.981301 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: machine: x86_64 Jul 14 10:12:55.981427 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: clock source: unix Jul 14 10:12:55.981547 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: pcre jit disabled Jul 14 10:12:55.981657 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: detected number of CPU cores: 4 Jul 14 10:12:55.981765 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: current working directory: / Jul 14 10:12:55.981886 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: detected binary path: /usr/bin/uwsgi-core Jul 14 10:12:55.982012 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: your processes number limit is 47680 Jul 14 10:12:55.982126 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: your memory page size is 4096 bytes Jul 14 10:12:55.982261 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: detected max file descriptor number: 2048 Jul 14 10:12:55.982261 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: lock engine: pthread robust mutexes Jul 14 10:12:55.982458 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: thunder lock: enabled Jul 14 10:12:55.982614 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 10:12:55.982709 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 10:12:56.027766 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: Python main interpreter initialized at 0x55df543339c0 Jul 14 10:12:56.027766 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: python threads support enabled Jul 14 10:12:56.027766 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: your server socket listen backlog is limited to 100 connections Jul 14 10:12:56.027766 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: your mercy for graceful operations on workers is 90 seconds Jul 14 10:12:56.028240 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 10:12:56.028240 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: *** Operational MODE: preforking *** Jul 14 10:12:56.028486 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: *** uWSGI is running in multiple interpreter mode *** Jul 14 10:12:56.028486 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: spawned uWSGI master process (pid: 117792) Jul 14 10:12:56.028697 dv-cinder-849800-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 10:12:56.029286 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: spawned uWSGI worker 1 (pid: 117809, cores: 1) Jul 14 10:12:56.029629 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: spawned uWSGI worker 2 (pid: 117810, cores: 1) Jul 14 10:12:56.032067 dv-cinder-849800-1-iscsi devstack@n-api.service[117792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 10:12:56.685763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:12:56.687289 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 10:12:57.865901 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:12:57.865901 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: from cryptography.utils import int_from_bytes Jul 14 10:12:57.867173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:12:57.867173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: from cryptography.utils import int_from_bytes Jul 14 10:12:57.879082 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:12:57.879082 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: from cryptography.utils import int_from_bytes Jul 14 10:12:57.879613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 10:12:57.879613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: from cryptography.utils import int_from_bytes Jul 14 10:13:00.185986 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:13:00.186532 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:13:00.186757 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:13:00.187120 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:13:00.187373 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:13:00.187757 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.188084 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.188404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.188722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.189084 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.189399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.189715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.190037 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.190372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.190631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.190946 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.191268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-1-iscsi {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.191590 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.191898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.192207 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.192524 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.192829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.193174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.193482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.193970 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.194440 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.194750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.195061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.195399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.195725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.196031 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.196351 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.196668 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.197016 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.197332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.197738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-1-iscsi {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.198050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.198363 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.198682 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.199078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.199401 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.199712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.200035 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.200358 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.200666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.201974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.201974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.201974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.201974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203685 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.203920 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.204228 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.204589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.204888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.205233 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.205485 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.205585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 10:13:00.206008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.206107 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 10:13:00.206199 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.206296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 10:13:00.206381 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.206637 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 10:13:00.206733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.206895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 10:13:00.206996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.207230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.207333 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.207536 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.207664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.207841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.207938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.208144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.208237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.208448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.208542 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.208750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.208859 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.209089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.209183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.209402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.209504 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.209718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.209810 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.210560 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.210658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.210881 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.211004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.211216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849800-1-iscsi {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.211390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.211548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.211712 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.211862 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212453 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212662 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.212989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.213093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.213186 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.213350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.213453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.213654 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.213940 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214055 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214251 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214653 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.214972 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.215175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.215281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.215424 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.215539 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.215725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.215854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216023 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216336 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.216959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.217085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.217262 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.217434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849800-1-iscsi {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.217579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.217740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.217882 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.218055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.218159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.218374 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.218478 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.218745 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.218838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219348 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219649 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.219949 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.220043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.220249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.220350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.220567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.220669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.220886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221526 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221680 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.221978 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.222131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.222277 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.222418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.222566 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.222725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.222876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223015 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223479 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.223917 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224379 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.224832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.225075 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.225193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.225330 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.225433 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.226385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.226508 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.226605 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.226707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.226897 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.226999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.227199 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.227302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.227500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.227604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.227802 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.227903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.228103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.228195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.228406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.228511 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.228709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.228802 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.229033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.229180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.229337 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.229437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.229650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.229969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.230531 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.231017 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.231241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.231985 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.232192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.232324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.232438 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.232565 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.232565 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.232785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.232785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.233034 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.233148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.233272 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.233393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.233506 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.233625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.233743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.233863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.233988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.234100 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.234210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.234320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.234430 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.234547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.234673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.234786 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.234901 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.235020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.235131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.235253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.235365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.235474 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.235583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.235693 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.235802 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.235921 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.236038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.236157 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.236285 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.236402 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.236608 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.236740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.236883 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.237039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.237183 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.237324 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.237537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.237697 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.237857 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.238010 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.238163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.238314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.238468 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.238615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.238759 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.238903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.239067 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.239213 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.239366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.239512 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.239655 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.239798 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.239951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.240104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.240259 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.240404 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.240554 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.240706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.240863 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.241108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.241377 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.241634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.241833 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.241989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.242142 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.242396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.242548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.242929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.243089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.243089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.243375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.243531 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.243675 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.243825 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.243984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.244142 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.244286 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.244436 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.244628 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.244774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.244952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.245106 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.245261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.245416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.245571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.245723 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.245882 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.246035 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.246181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.246325 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.246474 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.246645 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.246877 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.247041 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.247270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.247431 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.247622 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.247782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.247926 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.248094 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.248241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.248385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.248683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.248851 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.249375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.249544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.249692 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.249847 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.249992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.250136 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.250302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.250455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.250602 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.250756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.250909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.251517 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.251634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.251730 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.251816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.251900 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.251992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.252089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.252175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.252267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.252522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.252640 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.252735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 10:13:00.252834 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.252919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253330 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253476 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253649 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253801 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253889 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.253975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254400 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254516 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.254997 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.255207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.255332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.255525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.255838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.255838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.256000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.256154 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.256248 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.256489 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.256589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.256916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257161 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257433 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257515 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257806 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.257905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.258205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.258379 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.258527 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.258670 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.258822 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.258991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.259131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.259274 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.259414 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.259562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.259715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.259865 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260440 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.260893 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261202 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261351 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261649 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261800 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.261945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262048 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262336 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262547 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262662 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262867 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.262971 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.263176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.263269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.263498 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.263595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.263816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.263923 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.264135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.264239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.264449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.264546 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.264763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.264862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.265105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.265213 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.265421 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.265521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.265735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.265824 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266452 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266673 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266834 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.266983 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267381 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267601 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267700 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267908 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.267999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.268223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.268312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.268530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.268627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.268835 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.268955 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.269179 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.269284 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.269504 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.269609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.269835 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.269934 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.270146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.270238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.270463 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.270555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.270773 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.270864 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.271086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.271199 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.271396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.271511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.271704 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.271801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.272017 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.272189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.272341 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.273167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.273167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.273469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.273618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.273766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.273915 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274351 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274495 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.274931 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.275071 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.275218 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.275370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.275520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.275669 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.275837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.276009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.276161 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.276556 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.276772 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.276950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277259 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.277989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.278131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.278308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.278403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.278527 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.278612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.278981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.279229 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.279543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.279642 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.279853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.279971 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.280164 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.280301 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.280469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.280614 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.280782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.280966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.281117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.281345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.281454 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.281577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.281712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.281887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.282021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.282204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.282400 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.282784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.283063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.283371 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.283690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.283799 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284084 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284333 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.284951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.285054 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.285267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.285395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.285576 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.285677 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.285923 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286233 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286324 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286542 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286636 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.286984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.287206 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.287301 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.287513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.287620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.287832 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.287920 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.288727 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.288842 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.289063 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.289174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.289383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.289483 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.289697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.289790 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290011 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290114 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290336 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290651 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.290962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.291069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.291279 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.291379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.291590 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.291689 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.291901 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.292003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.292213 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.292321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.292540 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.292662 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293010 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293143 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293250 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293351 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293535 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293840 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.293937 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.294151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.294250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.294471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.294569 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.294858 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.295049 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.295175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.295383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.295475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.295702 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.295806 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.296023 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.296124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.296343 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.296435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.296664 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.296756 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297137 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297693 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.297993 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.298206 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.298361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.298510 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.298652 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.298793 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.298935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299084 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299228 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299378 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.299962 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300251 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300677 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.300986 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.301134 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.301276 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.301432 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.301579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.301734 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.301887 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302091 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302237 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302533 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.302970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.303129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.303268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.303472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.303653 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.303793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.303943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.304092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.304265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.304416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.304637 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.304821 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.304908 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.305026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.305116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.305214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.305343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.305543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.305887 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.306210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.306404 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.306502 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.306757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.306840 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.307093 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.307176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.307469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.307573 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.307712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.307795 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.308024 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.308108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.308335 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.308425 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.308638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.308729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309869 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.309976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.310172 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.310273 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.310482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.310583 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.310785 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.310887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.311106 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.311200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.311416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.311517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.311722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.311836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312338 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312438 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312648 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312749 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.312972 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.313094 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.313283 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.313383 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.313768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.313874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.313950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314195 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314624 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.314892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.315093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.315200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.315404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.315505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.315710 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.315809 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.316035 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.316143 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.316348 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.316454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.316656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.316961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.319113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.319812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.319971 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.319971 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.320267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.320412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.320557 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.320716 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.320869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321053 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321210 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321799 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.321943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.322103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.322268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.322427 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.322580 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.322726 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.322869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.323058 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.323210 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.323355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.323498 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.323641 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.326850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.327702 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.327862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.328062 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.328209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.328370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.328565 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.328712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.328863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329106 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329256 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329410 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329786 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.329896 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.330008 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.330169 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.330294 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.330414 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.330532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.331247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.331247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.331485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.331605 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.331724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.331724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.332804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.332965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333104 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333256 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333794 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.333953 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.334352 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.334490 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.334630 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.334760 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.335007 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.337793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.338509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.338647 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.338780 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.338924 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339056 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339431 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339549 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339713 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.339973 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.340092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.341031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.343839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344015 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344339 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344617 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344765 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.344953 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345357 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345357 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.345752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346037 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346429 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346558 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346828 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.346828 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.347107 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.347246 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.347384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.347525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.347525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.347786 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349209 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349356 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349489 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.349756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.350268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.350398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.350398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.351439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.351587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.351587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.351587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.351587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.353348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.353504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.353649 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.353787 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.353787 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.354040 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.354178 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.354324 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.354462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.354592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.354728 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.355427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.355572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.355719 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.355857 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357365 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357777 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.357777 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.358035 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.358197 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.358197 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.359516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.360234 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.360380 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.360525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.360525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.361762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.361905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.361905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.362193 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.362334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.362474 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.362965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.362965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.363726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.363872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.363872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.364146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.366866 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.367312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.367450 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.367636 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.367782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.367925 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368057 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368770 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.368770 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369209 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369339 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369468 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369612 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.369748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370015 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.370272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.371735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.371735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.371735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.371735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.373076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.373322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.373465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.374133 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.374275 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.374433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.374747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.374938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.375292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.375445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.375578 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.375716 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.375847 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377337 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.377481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.378471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.378602 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.378744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.378875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379157 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.379872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380001 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380130 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.380272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.381583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.381583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.382344 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.382476 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.382619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.382756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.382894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383024 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383024 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383284 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383422 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383422 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.384952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.385082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.385235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.385566 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.385718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.385855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.385855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386098 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386227 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386365 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.386873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.387134 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.387270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.387407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.387543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.387543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.387830 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388178 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388178 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388429 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388565 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388703 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.388842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.389454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.390416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.390416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.390416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.390416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.390416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.391268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.391268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.391616 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.392119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.392551 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.398033 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.398033 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.399329 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.399484 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.399642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.399788 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.399925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.400070 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.400238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.400371 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.401530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.401686 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.401829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.401976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.402252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.403335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.403335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.403606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.403746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.403967 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.404102 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.404263 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.404396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.404534 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.405421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.405421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.405695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.405695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.405968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.406435 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.406589 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.406589 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.406589 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.407744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.407885 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.408024 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.408165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.408165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.408165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.408165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.410646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.410789 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.410947 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411093 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411093 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411093 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411093 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411633 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411780 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.411913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.412839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.413331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.414597 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.414741 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.414881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415155 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415299 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415431 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415604 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415744 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.415744 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416007 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.416151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419453 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.419879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.420493 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.420625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.420625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.420879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421693 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421822 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.421959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.422103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.423466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.423466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.423466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.427476 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.427476 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.427737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.427883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428017 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428278 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428538 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428715 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.428859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429045 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429178 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.429874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430011 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430149 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.430430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.431167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.431294 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.433738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.433738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434238 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434374 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434654 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.434927 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435065 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.435816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437010 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437010 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437306 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437450 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.437720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.438832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.438997 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.439147 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.439282 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.439413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.439413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.439829 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.441606 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.441802 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.441951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442359 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442500 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.442898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.443027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.443027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.443027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.443397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.443709 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.444173 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.444915 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.445227 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.445625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.445902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.446012 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.446393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.447046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.447171 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.447446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.447862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.448068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.448320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.448725 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.448967 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.449205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.449609 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.449850 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.450054 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.450443 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.450808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.450912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.451205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.451596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.451764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.452060 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.452465 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.452567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.452888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.453294 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.453488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.453742 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.454131 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.454625 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.454738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.455171 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.455479 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.455598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.455962 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.456300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.456419 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.456761 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.457172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.457578 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.457967 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.458354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.458632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.458735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.459126 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.459435 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.459537 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.459872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.460876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.461233 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.461348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.461668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.462027 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.462131 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.462418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.462823 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.463009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.463258 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.463641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.463904 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.464014 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.464413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.464801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.465208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.465591 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.465973 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.466283 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.466403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.466730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.467118 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.467505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.467743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.467886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.468415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.468675 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.469039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.469218 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.469413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.472955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473847 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473847 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.473999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474094 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474181 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474274 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474368 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474463 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474556 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.474826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475120 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475448 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.475987 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.476423 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.476668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.477191 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.477679 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.478173 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.478359 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.478801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.479179 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.479443 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.479914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.480046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.480509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.480831 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.481211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.481424 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.481864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.481989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.482360 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.482605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.482868 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.483244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.483375 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.483740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.484434 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.484803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.485208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.485592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.485932 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.486265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.486360 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.486597 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.486692 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.486929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.487256 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.487579 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.487899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.487992 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.488221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.488460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.488553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.488872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.489024 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.489221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.489409 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.489556 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.489968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.490290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.490419 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.490619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.490949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.491289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.491512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.491655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.491938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.492069 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.492255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.492461 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.492601 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.492906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.493067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.493306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.493455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.493656 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.493848 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.493981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.494314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.494640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.494970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.495228 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.495370 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.495594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.495873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.496014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.496188 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.496437 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.496578 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.496793 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.496953 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.497151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.497463 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.497637 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.497769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.498068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.498290 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.498434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.498679 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.498817 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.499415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.499560 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.499690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.499690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500020 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500535 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.500843 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.501096 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.501289 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.501427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.501701 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.501830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.502014 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.502234 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.502363 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.502645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.502783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.502987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.503307 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.503634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.503769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.503951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.504152 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.504290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.504578 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.504982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.505246 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.505396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.505577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.505790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.505929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.506220 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.506537 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.507265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.507414 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.507670 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.507987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.508117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.508301 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.508565 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.508704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.509034 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.509188 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.509327 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.509567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.509711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.509962 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.510092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.510282 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.510477 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.510619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.510914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.511044 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.511230 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.511420 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.511560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.511863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.511994 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.512179 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.512355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.512499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.512792 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.512961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.513220 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.513507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.513679 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.513873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.514082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.514287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.514485 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.514684 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.514887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.515302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.515544 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.515789 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.516102 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.516309 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.516520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.516520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.516966 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.517169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.517169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.517584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.517808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.518030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.518240 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.518240 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.518629 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.518844 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.518844 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.519362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.519574 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.519574 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:13:00.519995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.519995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.520529 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.520961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.521379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.521776 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.522237 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.523444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.524598 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.524598 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.524598 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.527081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.527081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.527081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.527081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.527895 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.528469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.528870 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.529390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.529724 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.530117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.530521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.530914 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.532708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.533260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.533689 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.534110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.534510 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.534908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.535305 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.535733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.536143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.536539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.537266 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.537661 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.538558 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.539228 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.539619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.540011 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.540757 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.541012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.541340 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.541662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.541980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.542298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.542617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.542933 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.543253 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.543569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.543885 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.544197 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.544511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.544821 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.545204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.545549 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.545937 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.546190 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.546512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.546838 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.547370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.547709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.548076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.548480 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.548832 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.549203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.549526 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.549909 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.550231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.550550 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.550869 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.551189 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.551600 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.551939 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.552257 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.552689 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.553077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.553412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.553784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.554105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.554444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.554788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.555109 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.555428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.555747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.556124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.556369 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.556689 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.557029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.557539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.557878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.558218 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.558553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.558871 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.559206 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.559539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.559902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.560225 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.560577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.560910 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.561256 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.561573 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.561886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 10:13:00.562136 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 10:13:00.672918 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO dbcounter [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Registered counter for database nova_api Jul 14 10:13:00.694205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.701478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writer thread running {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.714481 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO dbcounter [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Registered counter for database nova_api Jul 14 10:13:00.734098 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_db.sqlalchemy.engines [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.740648 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writer thread running {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.758668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.context [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1ffe045-142f-4ef4-ace8-4e9048e3e1e9(cell1) {{(pid=117809) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:13:00.762853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.764433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.765283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.767268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.769254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO dbcounter [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Registered counter for database nova_cell0 Jul 14 10:13:00.773268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO dbcounter [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Registered counter for database nova_cell1 Jul 14 10:13:00.780897 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.782291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.787902 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writer thread running {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.797672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.context [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a1ffe045-142f-4ef4-ace8-4e9048e3e1e9(cell1) {{(pid=117810) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 10:13:00.801853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.803421 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.804778 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:00.806788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:00.808744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO dbcounter [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Registered counter for database nova_cell0 Jul 14 10:13:00.812731 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO dbcounter [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Registered counter for database nova_cell1 Jul 14 10:13:00.820735 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_db.sqlalchemy.engines [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.822095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_db.sqlalchemy.engines [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.829752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writer thread running {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.830101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writer thread running {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.925755 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writer thread running {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.936326 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO dbcounter [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Registered counter for database nova_cell0 Jul 14 10:13:00.943283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_db.sqlalchemy.engines [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.949366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writer thread running {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:00.977177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO dbcounter [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Registered counter for database nova_cell0 Jul 14 10:13:00.983958 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_db.sqlalchemy.engines [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 10:13:00.988585 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writer thread running {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 10:13:01.273797 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: WARNING keystonemiddleware.auth_token [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:13:01.281392 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: WARNING keystonemiddleware.auth_token [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:13:01.314356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: WARNING keystonemiddleware.auth_token [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:13:01.321707 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: WARNING keystonemiddleware.auth_token [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:13:01.630721 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: WARNING keystonemiddleware.auth_token [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:13:01.636905 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: WARNING keystonemiddleware.auth_token [None req-6fd10ed7-66ba-4cd0-8548-557ea6a61b29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:13:01.643304 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df543339c0 pid: 117809 (default app) Jul 14 10:13:01.666510 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: WARNING keystonemiddleware.auth_token [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 10:13:01.672489 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: WARNING keystonemiddleware.auth_token [None req-e6fd7fce-7849-429e-9899-be233acb2a94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 10:13:01.678862 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df543339c0 pid: 117810 (default app) Jul 14 10:13:42.616263 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:42.617707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:42.618608 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:42.619383 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:44.550486 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-bfbc68bd-425a-4f2b-9d59-fad609f80b0c tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Action: 'create', calling method: .version_select at 0x7f56278ccc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-808497542", "metadata": {"Type": "work"}}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:47.574752 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-bfbc68bd-425a-4f2b-9d59-fad609f80b0c tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.971599 Jul 14 10:13:47.576692 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jul 14 10:13:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4975 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 10:13:47.595280 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:47.596729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:47.600665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:47.602878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:13:47.975495 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8685493d-8937-4482-92d7-d27c60181632 tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Calling method '.version_select at 0x7f5627919820>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:48.556844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8685493d-8937-4482-92d7-d27c60181632 tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081" status: 200 len: 353 microversion: 2.1 time: 0.971352 Jul 14 10:13:48.563200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 1/2] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:13:47 2022] GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081 => generated 353 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:48.569570 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4c2a26e6-a062-4a47-baea-12a8cc2b5a6a tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Calling method '.version_select at 0x7f5627793a60>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:48.675663 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4c2a26e6-a062-4a47-baea-12a8cc2b5a6a tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081" status: 200 len: 353 microversion: 2.1 time: 0.110554 Jul 14 10:13:48.689298 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:13:48 2022] GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:48.699841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b1d372a-67a0-497a-a46b-d36bdb3b08d7 tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Calling method '.version_select at 0x7f56277dfa60>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:48.905893 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6b1d372a-67a0-497a-a46b-d36bdb3b08d7 tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081" status: 202 len: 0 microversion: 2.1 time: 0.213508 Jul 14 10:13:48.907097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:13:48 2022] DELETE /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:13:48.915784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d1e5af58-0def-4ad0-bf5c-609845bd8b57 tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Calling method '.version_select at 0x7f5627793d30>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:49.033506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d1e5af58-0def-4ad0-bf5c-609845bd8b57 tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081" status: 200 len: 352 microversion: 2.1 time: 0.122397 Jul 14 10:13:49.034084 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:13:48 2022] GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:13:50.047434 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-70353388-b983-494c-af09-1dedf3d2fc1b tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Calling method '.version_select at 0x7f56277a1160>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:50.133426 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-70353388-b983-494c-af09-1dedf3d2fc1b tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] HTTP exception thrown: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-70353388-b983-494c-af09-1dedf3d2fc1b tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Request method failure captured: Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081 HTTP/1.1 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xWNLD63mgHBgNz6jeukJ7PN4vObdBMntLymoPKyi7YiTeXCuQJW_A6UpFFnV5VYBH2jE0Hy9BaEUIlRj9ZqcETgjVmc6ws_b7fV_-zH23TiakNvyTHAwi4hxssPiEK5sogjvbzGmkw4qkhXh2nRBWZbKyExkCEPk0m_Ey2LG4nAV0 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a047dd397bbe42c487a4a2dce8cf6517 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-VolumesGetTestJSON-383508317 Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:13:50.138331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a047dd397bbe42c487a4a2dce8cf6517", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a047dd397bbe42c487a4a2dce8cf6517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a047dd397bbe42c487a4a2dce8cf6517"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a047dd397bbe42c487a4a2dce8cf6517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-VolumesGetTestJSON-383508317 Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a047dd397bbe42c487a4a2dce8cf6517 Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-VolumesGetTestJSON-383508317 Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-VolumesGetTestJSON-383508317-project Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: b8e0c072b7a24d30893957523763e851 Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-VolumesGetTestJSON-383508317-project Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '45ae1ca1-32f2-4cd8-bc80-1e783d440081'} Jul 14 10:13:50.139679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. (HTTP 404) (Request-ID: req-f74381df-174c-47a9-a4cc-66fa7dc42e00) Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:50.140500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:13:50.141666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 10:13:50.142688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-70353388-b983-494c-af09-1dedf3d2fc1b tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] Returning 404 to user: Volume 45ae1ca1-32f2-4cd8-bc80-1e783d440081 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-70353388-b983-494c-af09-1dedf3d2fc1b tempest-VolumesGetTestJSON-383508317 tempest-VolumesGetTestJSON-383508317-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081" status: 404 len: 109 microversion: 2.1 time: 0.097029 Jul 14 10:13:50.143769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 3/6] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:13:50 2022] GET /compute/v2.1/os-volumes/45ae1ca1-32f2-4cd8-bc80-1e783d440081 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:13:56.340613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-556023752", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "networks": [{"uuid": "2fa3ec6c-5616-438b-b8f9-070972840b0b"}]}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:56.664553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] validate_networks() for [('2fa3ec6c-5616-438b-b8f9-070972840b0b', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:13:58.815058 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-36acc4b2-7c30-4523-b1a9-2a446cc4356b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: .version_select at 0x7f5627708160>, body: {"keypair": {"name": "tempest-keypair-219532342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpzyv13AclaqWoadwNWz/GweiOwRx/M+m28qAyJ/T9wHffaLQjIYYQAk2g0x+egxTiC2rUmb4wY3qWVf3R1CEaiEzWmyCwQgAdFO0gVrsJqdElUKMB9E900JESJrK6k2g=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:58.994558 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-36acc4b2-7c30-4523-b1a9-2a446cc4356b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:13:59.020159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-36acc4b2-7c30-4523-b1a9-2a446cc4356b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:13:59.218250 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-36acc4b2-7c30-4523-b1a9-2a446cc4356b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.605033 Jul 14 10:13:59.219667 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 4/7] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:13:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:13:59.383118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-547704711", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:13:59.435399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:13:59.435399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:13:59.435399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:13:59.435399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:13:59.435399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:13:59.455048 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:59.455509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:59.456299 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:13:59.456747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:13:59.542039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Getting quotas for project 7a5b4dfcb90d421192be6dbc102ca1bb. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:13:59.571201 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Getting quotas for user fed44db7dc014719b5ed0399c715435b and project 7a5b4dfcb90d421192be6dbc102ca1bb. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:13:59.614866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:13:59.625327 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] validate_networks() for [('c86764b5-6320-470e-8466-fc72ac9ee1be', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:13:59.630205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:13:59.900094 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-327b4267-47b6-4113-be6f-5c30d117df69 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.042009 Jul 14 10:13:59.909347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 4/8] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 4052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:13:59.919564 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6c74625c-b6b0-4343-ab4b-2776ecef0508 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:13:59.920873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6c74625c-b6b0-4343-ab4b-2776ecef0508 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:00.136250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6c74625c-b6b0-4343-ab4b-2776ecef0508 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:00.180088 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6c74625c-b6b0-4343-ab4b-2776ecef0508 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1214 microversion: 2.1 time: 0.269150 Jul 14 10:14:00.181163 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:13:59 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:01.212055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1504e459-30a0-4e17-8fac-f22c7be764e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:01.212685 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1504e459-30a0-4e17-8fac-f22c7be764e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:01.967176 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1504e459-30a0-4e17-8fac-f22c7be764e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:01.976022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1504e459-30a0-4e17-8fac-f22c7be764e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1214 microversion: 2.1 time: 0.776716 Jul 14 10:14:01.978461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 6/10] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:01 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1214 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:02.254028 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:14:02.254513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:14:02.254913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:14:02.255317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:14:02.255746 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:14:02.280415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:02.280854 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:02.281679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:02.282118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:02.377186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:02.397830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for user ca339e26746a4feaaa25b14be59479a4 and project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:02.436119 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:14:02.444898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:14:02.594302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-435620da-9b7a-4068-b895-8017babdfea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.360193 Jul 14 10:14:02.595658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 5/11] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:13:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:14:02.606147 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fcb3a600-db50-4022-944b-575b7f4eb31e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:02.606767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fcb3a600-db50-4022-944b-575b7f4eb31e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:02.995654 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:02.996301 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:03.062673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:03.063143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:03.063944 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:03.064382 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:03.189356 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-fcb3a600-db50-4022-944b-575b7f4eb31e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:03.198671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fcb3a600-db50-4022-944b-575b7f4eb31e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1221 microversion: 2.1 time: 0.596535 Jul 14 10:14:03.211116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 7/12] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:02 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1221 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:03.457388 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1561197753", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:03.545732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:03.610750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8f5bec34-854f-4a2b-8ba5-0ca76b42336c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1266 microversion: 2.1 time: 0.610025 Jul 14 10:14:03.611607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 6/13] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:02 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1266 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:03.615396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] validate_networks() for [('c86764b5-6320-470e-8466-fc72ac9ee1be', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:14:04.474249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b5b394c0-c597-4749-8375-a4ab36604d46 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: .version_select at 0x7f5625d530d0>, body: {"keypair": {"name": "tempest-keypair-1832275976", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHHZuqIvq4nJNb/J58hNlrQn0PCJbYY4r9whXbY9KuVnMx2tKiZgR4gpIdnUlPAY3b9965PFTBusyP0qjWpGQdjUG6+nDvu8+ZRV7YNRlPx9oDTu584XlKTNP3ja2K/4A=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:04.502672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-b5b394c0-c597-4749-8375-a4ab36604d46 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:04.517405 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-b5b394c0-c597-4749-8375-a4ab36604d46 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for user 01a9eebc1c8540daa31109cfc86d5ed1 and project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:04.634080 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b5b394c0-c597-4749-8375-a4ab36604d46 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.730809 Jul 14 10:14:04.636825 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 7/14] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:14:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:14:04.660393 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:04.662422 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:04.672666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:04.678267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:04.682245 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:04.682996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:04.834308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:04.845605 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3767a41a-7b6e-4f43-8efc-08ed4ab6bfde tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1272 microversion: 2.1 time: 0.207124 Jul 14 10:14:04.847263 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:04 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:05.863530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:05.864877 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:05.876547 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:05.887754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:05.888607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:05.889110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:06.125486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:06.152148 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-aeef371f-a9ca-4021-a6a5-3b11d2f78002 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1272 microversion: 2.1 time: 0.290599 Jul 14 10:14:06.155548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:05 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:06.267717 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:14:06.273557 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:14:06.275127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:14:06.275781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:14:06.276366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:14:06.308458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:06.311537 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:06.312911 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:06.320025 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:06.394464 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:06.400237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for user ca339e26746a4feaaa25b14be59479a4 and project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:06.443698 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:14:06.451026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:14:06.608142 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-222fd432-45d6-46db-8d3b-7f6ef9686fac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.151904 Jul 14 10:14:06.617978 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 8/17] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:14:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:14:06.621141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4f540b1d-0692-40f9-b783-00cc97cf71be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:06.621849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4f540b1d-0692-40f9-b783-00cc97cf71be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:07.177422 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:07.178051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:07.186386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.197468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.205442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:07.207703 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:07.278384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4f540b1d-0692-40f9-b783-00cc97cf71be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:07.303106 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4f540b1d-0692-40f9-b783-00cc97cf71be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1222 microversion: 2.1 time: 0.683395 Jul 14 10:14:07.321223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 10/18] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:06 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1222 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:07.994400 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-261506754", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f"}], "security_groups": [{"name": "tempest-securitygroup--1761798617"}], "key_name": "tempest-keypair-219532342", "user_data": "}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:08.643405 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:08.685283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3dff2562-ad17-4a24-8d43-3372909c4cf5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1272 microversion: 2.1 time: 1.510351 Jul 14 10:14:08.696141 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 9/19] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:07 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1272 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:08.709917 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:08.710556 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:08.724658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.743252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.745278 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:08.748126 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:08.782398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] validate_networks() for [('2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:14:09.808741 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:09.820850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-09e6c3b3-a2a6-42dd-8ce6-e40b987afda6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1274 microversion: 2.1 time: 1.122074 Jul 14 10:14:09.823658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 10/20] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:08 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1274 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:09.836946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:09.837845 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:09.851403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:09.852218 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:09.855200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:09.857511 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.004282 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:11.021961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-91f61f82-54b0-49a6-8b57-1d4d35f71cea tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 1.192322 Jul 14 10:14:11.034660 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 11/21] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:09 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:11.058267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:11.061695 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:11.102550 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.102942 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.114667 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:11.115274 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:11.603174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:11.612469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4a5740b1-eb05-467c-b2b7-3af66d3efeef tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1280 microversion: 2.1 time: 0.584002 Jul 14 10:14:11.623085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 12/22] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:11 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1280 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:12.049782 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:12.051432 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:12.071598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.074855 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.076340 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.078951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.329751 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:12.629290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:12.648494 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9e5c4a29-1415-4b45-b65c-bf8c66fe748c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.609015 Jul 14 10:14:12.649417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 13/23] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:12 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:12.673762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:12.675200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:12.679976 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:14:12.680620 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:14:12.681267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:14:12.681844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:14:12.682429 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:14:12.710790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.713269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.716180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.716867 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.717565 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.720573 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.721852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:12.723467 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:12.781607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:12.798188 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:12.835678 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:14:12.840127 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:14:12.937201 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:12.954659 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a8c0b581-832f-404a-b542-d8694f61f3ee tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1280 microversion: 2.1 time: 0.303867 Jul 14 10:14:12.969002 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 14/24] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:12 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1280 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:13.002475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0aef96ce-7357-4a21-a1fd-b9049478c431 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.015218 Jul 14 10:14:13.003134 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 11/25] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:14:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 5017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:14:13.017664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c9903160-63c2-465e-a4a3-fef55d54ee81 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:13.018614 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c9903160-63c2-465e-a4a3-fef55d54ee81 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:13.130053 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c9903160-63c2-465e-a4a3-fef55d54ee81 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:13.144652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c9903160-63c2-465e-a4a3-fef55d54ee81 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1240 microversion: 2.1 time: 0.130750 Jul 14 10:14:13.163937 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 15/26] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:13 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:13.673545 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:13.674553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:13.698956 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.698956 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.703299 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:13.703826 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:13.978604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:13.979654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:13.999025 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.001286 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.004086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.008777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.307235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:14.315291 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-81317df7-0274-4299-9c13-5817dca26e66 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.647253 Jul 14 10:14:14.315874 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 12/27] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:13 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:14.336164 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:14.346977 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a63f0bf8-35b3-4c5f-94c2-3e0c5831d359 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1280 microversion: 2.1 time: 0.374016 Jul 14 10:14:14.349014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:14.349650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:14.354968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 16/28] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:13 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1280 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:14.374285 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.374720 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.375514 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:14.375950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:14.601942 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-720304026", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71d0e822-864d-4ce6-a81f-385b20a87683"}], "security_groups": [{"name": "tempest-securitygroup--1400721544"}], "key_name": "tempest-keypair-1832275976", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:15.063848 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:15.087334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0d8d70de-e856-4f89-a180-f98d48e55943 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1244 microversion: 2.1 time: 0.767432 Jul 14 10:14:15.100462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 13/29] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:14 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1244 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:15.333859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:15.334641 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:15.368071 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:15.373807 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:15.378441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:15.384578 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:15.732545 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] validate_networks() for [('71d0e822-864d-4ce6-a81f-385b20a87683', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:14:16.372475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:18.396791 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:18.409088 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0eb6fd2c-3e83-43ba-98da-912e72943f49 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 3.080942 Jul 14 10:14:18.423685 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 14/30] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:15 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 3096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:18.433916 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:18.434543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:18.460795 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.462370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:18.465335 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:18.466738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.282833 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:14:19.283346 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:14:19.283890 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:14:19.284381 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:14:19.285135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:14:19.321604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.321870 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.323254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.323892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.347927 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:19.354805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for user 01a9eebc1c8540daa31109cfc86d5ed1 and project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:19.370509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:14:19.373850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:14:19.476987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ad7554d8-61f4-4477-8ef0-4b9e2a905a8b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.877947 Jul 14 10:14:19.480348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 17/31] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:14:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 4884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:14:19.493004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:19.493832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:19.505080 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.505712 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.507098 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:19.507748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:19.689804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:19.696451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:19.707275 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-eda1dcdf-3204-4367-a180-5afc400c741c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 1.277320 Jul 14 10:14:19.719164 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 15/32] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:18 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:19.723059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b1def0fe-6747-479e-a793-170f383f5025 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1298 microversion: 2.1 time: 0.220647 Jul 14 10:14:19.724446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 18/33] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:19 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1298 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:19.995172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-e682b9e9-fa8e-4233-a69e-3e3b6ce4465e req-7e35d21b-ec34-4be2-8124-bef372c6d11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafa60f3-c1a7-4417-86cc-18991a61e82f", "tag": "ce5d7280-4a51-4c65-ac60-5e8730133d1a"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:20.014261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-e682b9e9-fa8e-4233-a69e-3e3b6ce4465e req-7e35d21b-ec34-4be2-8124-bef372c6d11d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.015188 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-e682b9e9-fa8e-4233-a69e-3e3b6ce4465e req-7e35d21b-ec34-4be2-8124-bef372c6d11d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.066911 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-f1ad3f3f-e1e1-4184-a35e-5029b29e4c69 req-75922ae5-12ca-484c-b631-6d99313cddc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afff4cc-eaa2-4da3-8511-45d0b306c539", "tag": "92d02821-6f9a-4eb7-b48c-24008feeb3ed"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:20.079536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-e682b9e9-fa8e-4233-a69e-3e3b6ce4465e req-7e35d21b-ec34-4be2-8124-bef372c6d11d service nova] Creating event network-changed:ce5d7280-4a51-4c65-ac60-5e8730133d1a for instance fafa60f3-c1a7-4417-86cc-18991a61e82f on hv-cinder-84980 Jul 14 10:14:20.086738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-e682b9e9-fa8e-4233-a69e-3e3b6ce4465e req-7e35d21b-ec34-4be2-8124-bef372c6d11d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 10:14:20.090763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.091199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.095609 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.095894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.097347 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f1ad3f3f-e1e1-4184-a35e-5029b29e4c69 req-75922ae5-12ca-484c-b631-6d99313cddc4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.097814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f1ad3f3f-e1e1-4184-a35e-5029b29e4c69 req-75922ae5-12ca-484c-b631-6d99313cddc4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.133848 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.compute.rpcapi [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 10:14:20.137076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] Releasing lock "compute-rpcapi-router" {{(pid=117809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 10:14:20.171482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-f1ad3f3f-e1e1-4184-a35e-5029b29e4c69 req-75922ae5-12ca-484c-b631-6d99313cddc4 service nova] Creating event network-changed:92d02821-6f9a-4eb7-b48c-24008feeb3ed for instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 on hv-cinder-84980 Jul 14 10:14:20.172537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f1ad3f3f-e1e1-4184-a35e-5029b29e4c69 req-75922ae5-12ca-484c-b631-6d99313cddc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 10:14:20.175717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.178955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.179993 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.182675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.189342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0590c497-610c-47b1-a02c-ef60d748e896 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459801 Jul 14 10:14:20.190343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 19/34] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:20.201376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.202138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.210455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.compute.rpcapi [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 10:14:20.212249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] Releasing lock "compute-rpcapi-router" {{(pid=117810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 10:14:20.218028 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.218477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.219262 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.219698 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.254344 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5786e53f-62ac-406d-8c05-6c89f16c6a34 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.529799 Jul 14 10:14:20.254951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 16/35] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:20.267078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.267800 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.279077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.279248 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.285664 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.286311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.558680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:20.571557 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-80bb2122-6219-46dc-a59f-3e89f6dac509 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1241 microversion: 2.1 time: 0.315126 Jul 14 10:14:20.581117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 17/36] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1241 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:20.702767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:20.711263 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1f298dd3-bd0b-457a-a322-f6be1aef5d06 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.519682 Jul 14 10:14:20.721216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 20/37] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:20.730820 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.731985 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.744163 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:20.744792 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:20.757612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.762624 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.765407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.765888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.767566 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.775115 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:20.776145 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:20.776738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.103230 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:21.115986 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e8639f51-d2b4-4213-b8e8-bde53327a2aa tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1298 microversion: 2.1 time: 0.377423 Jul 14 10:14:21.116590 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 21/38] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1298 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:21.308226 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:21.326040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e686a70c-1ed1-4699-9ec6-c16765fca6dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.596277 Jul 14 10:14:21.327796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 18/39] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:20 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:21.589123 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:21.589943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:21.598875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.599621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.600604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.601759 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.694652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:21.705510 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a55f1a06-1dd6-4990-85ab-48e636358369 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1289 microversion: 2.1 time: 0.121174 Jul 14 10:14:21.715826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 22/40] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:21 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:21.728521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:21.729452 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:21.737158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.738207 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.739287 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:21.739744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:21.985844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:22.004484 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dd8f4e68-8f81-4148-8fc8-e837bb6ad7d2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.279311 Jul 14 10:14:22.005858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 19/41] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:21 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:22.132696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:22.133334 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:22.141078 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.141645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.142459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.146367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.343555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:22.344247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:22.351823 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.357414 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.358519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.359160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.360069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:22.399716 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-cbd891d5-cffe-4edc-92b4-7780522ce7a4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.270675 Jul 14 10:14:22.400314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 23/42] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:22 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:22.416492 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-49a70b6a-698f-48ee-bc81-a55a6008662f req-8f0c1a8c-2f20-4716-a45e-58cbe1ce6bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1c8e49-223d-4c87-bb65-79edca0dac61", "tag": "ae315f1e-83cb-48a2-a7c4-aec7aff8961d"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:22.433520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-49a70b6a-698f-48ee-bc81-a55a6008662f req-8f0c1a8c-2f20-4716-a45e-58cbe1ce6bf0 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.434349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-49a70b6a-698f-48ee-bc81-a55a6008662f req-8f0c1a8c-2f20-4716-a45e-58cbe1ce6bf0 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.450070 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-49a70b6a-698f-48ee-bc81-a55a6008662f req-8f0c1a8c-2f20-4716-a45e-58cbe1ce6bf0 service nova] Creating event network-changed:ae315f1e-83cb-48a2-a7c4-aec7aff8961d for instance dc1c8e49-223d-4c87-bb65-79edca0dac61 on hv-cinder-84980 Jul 14 10:14:22.457991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-49a70b6a-698f-48ee-bc81-a55a6008662f req-8f0c1a8c-2f20-4716-a45e-58cbe1ce6bf0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046421 Jul 14 10:14:22.462280 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 24/43] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:22.681982 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:22.696439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-70b10eec-c5c1-408c-a4a3-dafa7a2ba5a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.356263 Jul 14 10:14:22.697110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 20/44] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:22 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:22.723669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:22.725702 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:22.736599 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.737251 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.739214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:22.741658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:22.872082 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:22.882596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-15d109f3-74cb-45ee-8d4e-59529e561ea2 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1297 microversion: 2.1 time: 0.162764 Jul 14 10:14:22.883283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 25/45] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:22 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1297 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:23.023501 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:23.024591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:23.026707 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=22 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:23.040666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.051635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.051635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.051635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.418249 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:23.418869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:23.427513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.427968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.428795 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.429267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.669793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:23.677345 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-23745641-b6b8-43e6-af1e-d928122d5dc2 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.658261 Jul 14 10:14:23.686075 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 21/46] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:23 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:23.714059 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:23.714912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:23.730635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.731309 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:23.732282 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:23.732843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.094163 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:24.107222 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c8bfba7c-5226-4533-aa68-26e62ad9c6b0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.691264 Jul 14 10:14:24.108141 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 26/47] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:23 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:24.124382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:24.125313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:24.129076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:24.134234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.134976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.136026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.137352 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.168384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:24.396201 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:24.409183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-92998227-657f-403c-a4cf-1403664fe5d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1295 microversion: 2.1 time: 0.290804 Jul 14 10:14:24.414132 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 27/48] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:24 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1295 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:24.474517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-fea17803-3053-48cf-8ae9-accee945bbe7 req-48036d47-6ca9-46e8-b223-4360f321409f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ac6d8d-492d-45da-ac13-5688fc6e2bb6", "tag": "81f609dc-8842-42ec-9605-22d13d78fb55"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:24.499126 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:24.499837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-fea17803-3053-48cf-8ae9-accee945bbe7 req-48036d47-6ca9-46e8-b223-4360f321409f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.500317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-fea17803-3053-48cf-8ae9-accee945bbe7 req-48036d47-6ca9-46e8-b223-4360f321409f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.514077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ddaf3ad1-fa56-48f6-8667-05e548ccabf6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.802172 Jul 14 10:14:24.517105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 22/49] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:23 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:24.526577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-fea17803-3053-48cf-8ae9-accee945bbe7 req-48036d47-6ca9-46e8-b223-4360f321409f service nova] Creating event network-changed:81f609dc-8842-42ec-9605-22d13d78fb55 for instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 on hv-cinder-84980 Jul 14 10:14:24.532665 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-fea17803-3053-48cf-8ae9-accee945bbe7 req-48036d47-6ca9-46e8-b223-4360f321409f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064682 Jul 14 10:14:24.533620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 28/50] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:14:24.704080 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:24.707827 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:24.714777 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.715240 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:24.716094 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:24.716511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.126418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.127202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.133729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.134225 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.135197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.135787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.227845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:25.252067 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-39e15696-706e-4aa1-a104-5f7b6ad23888 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.547225 Jul 14 10:14:25.255512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 23/51] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:24 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:25.430664 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.431571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.442763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.443409 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.444553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.447133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.654711 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:25.667043 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c91a9e21-406d-43fd-8940-7983cb7d54a8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1295 microversion: 2.1 time: 0.240215 Jul 14 10:14:25.671369 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 24/52] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1295 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:25.681562 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:25.683890 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:25.699727 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.702488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.703673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:25.705459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:25.743596 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=100 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:26.082917 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:26.095655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2eeeeb1b-6887-4d8a-9f81-8b8f9e811995 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.972579 Jul 14 10:14:26.096253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 29/53] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:26.272573 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:26.275500 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:26.282509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:26.283279 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:26.284279 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:26.284972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:26.719964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:26.729922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f89b93b3-ddd4-41aa-964d-592b1d4b6cd5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 1.056499 Jul 14 10:14:26.740754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 25/54] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:25 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:26.748555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:26.749549 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:26.755755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:26.757124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:26.758093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:26.758735 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:26.791013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:26.799923 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-366390f3-6278-4f35-a22e-1e0f070b4e4a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.532157 Jul 14 10:14:26.801174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 30/55] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:26 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:26.876859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:26.893886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8b1240fd-8935-4c1b-a6ce-6f9ce0abe22e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1295 microversion: 2.1 time: 0.150020 Jul 14 10:14:26.905050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 26/56] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:26 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1295 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:27.115411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:27.116580 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:27.123179 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.123637 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.124430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.124866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.540244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:27.572618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-376a27f5-2708-4184-aeb0-b1c6a10d6c75 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.454858 Jul 14 10:14:27.575043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 31/57] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:27 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:27.751319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:27.751936 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:27.755135 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:27.767940 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.769001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.771902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.773268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.819946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:27.821350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:27.839320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.841521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:27.843741 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:27.845587 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:28.453624 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:28.464535 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:28.474455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c6db42eb-72a6-480d-9c8c-9afb87917924 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.730606 Jul 14 10:14:28.476021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 27/58] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:27 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:28.480775 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f5e99667-ea5e-4bbc-b9ba-8425ee560544 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.666244 Jul 14 10:14:28.483954 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:28.484790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:28.493253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 32/59] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:27 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:28.493824 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:28.494491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:28.495884 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:28.496713 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:28.592823 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:28.593517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:28.607407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:28.608003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:28.608811 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:28.611390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.364201 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=26 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:29.367843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:29.385451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2ec5cbc3-6f0d-4a20-bb71-7e5b07ac4a5d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.908059 Jul 14 10:14:29.386361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 28/60] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:28 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:29.390796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-79fe846c-a13e-49eb-b110-082ae168e5a0 req-7832dd72-9b59-424a-96df-5fdfe8083e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5e53dd-665c-4eb7-a9b9-94555c21df75", "tag": "60884b85-920e-41c7-b0fe-f0bd7728bc60"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:29.411976 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-79fe846c-a13e-49eb-b110-082ae168e5a0 req-7832dd72-9b59-424a-96df-5fdfe8083e5d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.415905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-79fe846c-a13e-49eb-b110-082ae168e5a0 req-7832dd72-9b59-424a-96df-5fdfe8083e5d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.438100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-79fe846c-a13e-49eb-b110-082ae168e5a0 req-7832dd72-9b59-424a-96df-5fdfe8083e5d service nova] Creating event network-changed:60884b85-920e-41c7-b0fe-f0bd7728bc60 for instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 on hv-cinder-84980 Jul 14 10:14:29.444245 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-79fe846c-a13e-49eb-b110-082ae168e5a0 req-7832dd72-9b59-424a-96df-5fdfe8083e5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056518 Jul 14 10:14:29.446312 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 29/61] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:29.452070 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:29.468406 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4efcb97a-d96e-4968-a92c-e8a8f26c4461 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.877388 Jul 14 10:14:29.475118 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 33/62] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:28 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:29.502130 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:29.502805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:29.519401 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.519866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.527888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.528216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.753554 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-765a7cb5-30e5-4b22-9e20-5af9f37d14a2 req-c3cb9186-fa3f-4ab0-8cbc-cbfc484da62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafa60f3-c1a7-4417-86cc-18991a61e82f", "name": "network-vif-plugged", "status": "completed", "tag": "ce5d7280-4a51-4c65-ac60-5e8730133d1a"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:29.776601 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-765a7cb5-30e5-4b22-9e20-5af9f37d14a2 req-c3cb9186-fa3f-4ab0-8cbc-cbfc484da62b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.777218 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-765a7cb5-30e5-4b22-9e20-5af9f37d14a2 req-c3cb9186-fa3f-4ab0-8cbc-cbfc484da62b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.781949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:29.794770 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2cae0f46-0360-4500-a885-0202863a6c59 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.304887 Jul 14 10:14:29.805619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 34/63] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:29 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:29.805619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:29.805619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:29.808601 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.809118 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.810456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:29.810977 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:29.825774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-765a7cb5-30e5-4b22-9e20-5af9f37d14a2 req-c3cb9186-fa3f-4ab0-8cbc-cbfc484da62b service nova] Creating event network-vif-plugged:ce5d7280-4a51-4c65-ac60-5e8730133d1a for instance fafa60f3-c1a7-4417-86cc-18991a61e82f on hv-cinder-84980 Jul 14 10:14:29.838079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-765a7cb5-30e5-4b22-9e20-5af9f37d14a2 req-c3cb9186-fa3f-4ab0-8cbc-cbfc484da62b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.390271 Jul 14 10:14:29.839636 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 30/64] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:30.003387 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:30.015925 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9164a404-48d9-45c2-8088-3ccfb61a2131 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.218635 Jul 14 10:14:30.017328 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 35/65] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:29 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:30.403260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:30.404126 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:30.410127 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=4 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:30.412415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.413493 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.414452 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.415211 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.498289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:30.499006 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:30.502519 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:30.512267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.514208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.517067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.517067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.663687 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:30.671248 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dcbe0edf-8eea-430f-815c-ac4bc829225b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.272778 Jul 14 10:14:30.672070 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 31/66] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:30 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:30.740506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:30.751216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e4fe8449-cd1f-4167-9837-9f60cd3b1067 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.257431 Jul 14 10:14:30.752980 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 36/67] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:30 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:30.812521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:30.813160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:30.819636 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.820095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.820866 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:30.821329 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:30.972599 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:30.980764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d5b59311-81fa-4b59-80eb-9df03e8e6e3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.171973 Jul 14 10:14:30.981666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 32/68] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:30 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:31.033896 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:31.034547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:31.041924 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.042568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.046124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.046124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.217635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:31.225983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-63e5583c-1226-4e92-a085-0e7dd1ed18d5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.196638 Jul 14 10:14:31.226666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 37/69] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:31 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:31.689912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:31.691330 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:31.698725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.699374 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.700156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.700620 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.768865 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:31.769796 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:31.775880 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.776335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.777205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.777913 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.922292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:31.937820 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d61bc83d-ef34-4393-8bc3-301bedd50615 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.253537 Jul 14 10:14:31.938443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 33/70] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:31 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:31.942882 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-ea7c23a7-2061-4f5b-8e36-ef7fb18bf62d req-e0caf100-9af5-4640-b5da-8bcd260f06b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afff4cc-eaa2-4da3-8511-45d0b306c539", "name": "network-vif-plugged", "status": "completed", "tag": "92d02821-6f9a-4eb7-b48c-24008feeb3ed"}, {"server_uuid": "dc1c8e49-223d-4c87-bb65-79edca0dac61", "name": "network-vif-plugged", "status": "completed", "tag": "ae315f1e-83cb-48a2-a7c4-aec7aff8961d"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:31.955554 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-ea7c23a7-2061-4f5b-8e36-ef7fb18bf62d req-e0caf100-9af5-4640-b5da-8bcd260f06b5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:31.956078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-ea7c23a7-2061-4f5b-8e36-ef7fb18bf62d req-e0caf100-9af5-4640-b5da-8bcd260f06b5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:31.976218 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-ea7c23a7-2061-4f5b-8e36-ef7fb18bf62d req-e0caf100-9af5-4640-b5da-8bcd260f06b5 service nova] Creating event network-vif-plugged:92d02821-6f9a-4eb7-b48c-24008feeb3ed for instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 on hv-cinder-84980 Jul 14 10:14:31.976839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-ea7c23a7-2061-4f5b-8e36-ef7fb18bf62d req-e0caf100-9af5-4640-b5da-8bcd260f06b5 service nova] Creating event network-vif-plugged:ae315f1e-83cb-48a2-a7c4-aec7aff8961d for instance dc1c8e49-223d-4c87-bb65-79edca0dac61 on hv-cinder-84980 Jul 14 10:14:31.986259 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:31.995632 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-377e6845-9aad-49c0-85dc-26f40ae387e1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.230406 Jul 14 10:14:31.996290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 38/71] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:31 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:31.998576 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-ea7c23a7-2061-4f5b-8e36-ef7fb18bf62d req-e0caf100-9af5-4640-b5da-8bcd260f06b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.058936 Jul 14 10:14:32.001584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 34/72] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:32.009556 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:32.010844 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:32.019011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:32.019467 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:32.020243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:32.020828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:32.249888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:32.254837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:32.279855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:32.282809 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:32.286534 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:32.287674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:32.457800 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:32.478030 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6c736f65-71b1-4df1-a958-2418a646bdf9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.480322 Jul 14 10:14:32.486348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 39/73] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:31 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:32.750270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:32.759501 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2d80c57d-895e-4e7f-8fb4-4c00b616e595 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.520002 Jul 14 10:14:32.760112 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 35/74] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:32 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:32.954338 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:32.954949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:32.962615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:32.963440 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:32.964658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:32.964658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.017113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:33.018390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:33.025575 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:33.026512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.027762 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:33.028415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.268469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:33.280674 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-adcc618d-9d40-4d96-af8e-f57e2be10bdc tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.329913 Jul 14 10:14:33.281022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:33.282552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 40/75] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:32 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:33.293448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-bb7c8412-4ba4-4165-8650-9a5e1502d770 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.281732 Jul 14 10:14:33.294438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 36/76] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:33 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:33.506444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:33.507768 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:33.514215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:33.514773 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.516384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:33.516808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.686335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:33.700385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9e2da875-fdb8-42e9-953e-860f0f51ccf0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.199713 Jul 14 10:14:33.701465 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 41/77] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:33 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:33.779697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:33.780475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:33.787246 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:33.788403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.789216 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:33.789891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:33.953511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:33.967857 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0ba57bfa-3007-4d12-ac6e-a23aae33c4c1 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.194290 Jul 14 10:14:33.968452 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 37/78] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:33 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:34.304974 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:34.306295 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:34.311984 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:34.312731 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:34.314774 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.315641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.318071 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.318790 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.323709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.326600 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.327419 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.327871 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.668629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:34.682395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0594df3c-febc-43f1-9235-624098a35fc5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.386456 Jul 14 10:14:34.682978 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 42/79] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:34 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:34.698742 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-dde6f7f2-9a54-415b-98f5-090dd087edb9 req-8021c276-07c2-4199-8af9-d6366b8ed785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ac6d8d-492d-45da-ac13-5688fc6e2bb6", "name": "network-vif-plugged", "status": "completed", "tag": "81f609dc-8842-42ec-9605-22d13d78fb55"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:34.716956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-dde6f7f2-9a54-415b-98f5-090dd087edb9 req-8021c276-07c2-4199-8af9-d6366b8ed785 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.717625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-dde6f7f2-9a54-415b-98f5-090dd087edb9 req-8021c276-07c2-4199-8af9-d6366b8ed785 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.732177 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-dde6f7f2-9a54-415b-98f5-090dd087edb9 req-8021c276-07c2-4199-8af9-d6366b8ed785 service nova] Creating event network-vif-plugged:81f609dc-8842-42ec-9605-22d13d78fb55 for instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 on hv-cinder-84980 Jul 14 10:14:34.755003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-dde6f7f2-9a54-415b-98f5-090dd087edb9 req-8021c276-07c2-4199-8af9-d6366b8ed785 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070208 Jul 14 10:14:34.755450 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 43/80] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:34.761968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:34.762859 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:34.772223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:34.781268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9c63c57a-6625-4659-aa82-21ca2e612cf6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.473825 Jul 14 10:14:34.785910 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.798488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 38/81] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:34 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:34.799184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.800023 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:34.800632 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:34.986153 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:34.987125 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:34.998873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:35.001091 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:35.003959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:35.005245 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:35.059262 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:35.073994 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-60494cf9-b622-477d-a6d4-4f5a02fbba0c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1322 microversion: 2.1 time: 0.317181 Jul 14 10:14:35.074599 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 44/82] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:34 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:35.385665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:35.393137 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5435875c-7c2f-47d8-be5f-108050f28b15 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1314 microversion: 2.1 time: 0.411507 Jul 14 10:14:35.399499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 39/83] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:34 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:35.700182 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:35.700804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:35.730652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:35.731039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:35.731839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:35.732283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:35.762866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:35.806345 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:35.806977 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:35.813720 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:35.814165 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:35.815484 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:35.815903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.163362 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:36.176240 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:36.177874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ce2c4388-ad94-45c2-a88e-41b0cc5b6f4e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.479761 Jul 14 10:14:36.190671 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8363d93d-83c6-4a39-b7c3-cd77693e67dc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.390019 Jul 14 10:14:36.191595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 40/84] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:35 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:36.193677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 45/85] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:35 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:36.198824 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:36.199460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:36.206183 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.206955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.207938 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.208746 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.416437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:36.417186 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:36.426845 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.427544 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.429268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.430247 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.541925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:36.555168 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6c1676a9-c60f-4d43-b316-352591007bc1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1517 microversion: 2.1 time: 0.362138 Jul 14 10:14:36.556504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 41/86] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:36 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1517 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:36.583925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:36.587407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:36.610665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.611440 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.612357 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.612772 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.715634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lazy-loading 'flavor' on Instance uuid dc1c8e49-223d-4c87-bb65-79edca0dac61 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:14:36.718727 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:36.730663 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-078269ef-1882-4a59-a7dd-daab98b0c4f9 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1501 microversion: 2.1 time: 0.318563 Jul 14 10:14:36.746368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 46/87] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:36 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1501 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:36.813659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:36.843899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-dbcd9321-8417-44f4-8cbd-e9cc6680dbfd req-def35de3-a77a-4660-a03e-2cd492458470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5e53dd-665c-4eb7-a9b9-94555c21df75", "name": "network-vif-plugged", "status": "completed", "tag": "60884b85-920e-41c7-b0fe-f0bd7728bc60"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:36.863354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-dbcd9321-8417-44f4-8cbd-e9cc6680dbfd req-def35de3-a77a-4660-a03e-2cd492458470 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.865033 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-dbcd9321-8417-44f4-8cbd-e9cc6680dbfd req-def35de3-a77a-4660-a03e-2cd492458470 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.881023 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-dbcd9321-8417-44f4-8cbd-e9cc6680dbfd req-def35de3-a77a-4660-a03e-2cd492458470 service nova] Creating event network-vif-plugged:60884b85-920e-41c7-b0fe-f0bd7728bc60 for instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 on hv-cinder-84980 Jul 14 10:14:36.891459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e3d674c4-3152-4050-87b6-b788e796ce36 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61/action" status: 200 len: 32 microversion: 2.1 time: 0.320001 Jul 14 10:14:36.893242 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-dbcd9321-8417-44f4-8cbd-e9cc6680dbfd req-def35de3-a77a-4660-a03e-2cd492458470 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056823 Jul 14 10:14:36.893985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 47/88] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:36.894160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 42/89] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:14:36 2022] POST /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61/action => generated 32 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:14:36.902602 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:36.904144 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:36.911805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.912369 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:36.913986 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:36.914578 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:37.127197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:37.146828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ced93b8b-8edd-4257-beef-bd640de64054 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.249552 Jul 14 10:14:37.148311 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 48/90] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:36 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:37.199079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:37.200768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:37.208718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:37.212945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:37.229704 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:37.231470 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:37.234427 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:37.235212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:37.235778 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:37.237073 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:37.244303 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:37.244946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:37.475118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:37.481839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:37.484796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-bc93a6c6-9bc5-4a33-87e9-bc6087defdae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.291643 Jul 14 10:14:37.489110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 43/91] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:37 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:37.492266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-10f39ba6-b62e-4d80-8406-092098e7abf4 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.287868 Jul 14 10:14:37.500793 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 49/92] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:37 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:38.165562 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:38.166203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:38.172130 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:38.172579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:38.173374 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:38.173808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:38.321157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:38.328760 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cad4ca11-782a-47c2-8f61-8af07d507928 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.167770 Jul 14 10:14:38.329470 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 44/93] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:38 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:38.502002 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:38.502623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:38.508847 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:38.509298 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:38.513696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:38.513696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:38.513864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:38.513864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:38.518631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:38.519237 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:38.520156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:38.520601 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:38.720339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:38.726934 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:38.733813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-63a524af-e4cb-4db2-a6ee-b16fdf53be9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.226571 Jul 14 10:14:38.734395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 45/94] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:38 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:38.734622 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0e700330-6e50-445d-b231-45a6068622d9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.236411 Jul 14 10:14:38.735428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 50/95] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:38 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:39.345481 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:39.346612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:39.354093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:39.354710 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:39.355653 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:39.356235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:39.497757 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:39.505094 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cfdfd938-0850-44c6-8c32-02fb2505560d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.163458 Jul 14 10:14:39.505692 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 46/96] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:39 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:39.750696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:39.751316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:39.751691 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:39.752306 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:39.757633 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:39.758080 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:39.758246 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:39.758682 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:39.759439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:39.759724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:39.759884 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:39.760177 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:39.954462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:39.958194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:39.964124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-694a0ec7-499b-4eaa-a444-18ee57bd7971 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.216775 Jul 14 10:14:39.964824 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 47/97] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:39 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:39.966873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-eb1a30b2-f691-41c6-b88c-63cbaa009ac7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.219950 Jul 14 10:14:39.967537 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 51/98] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:39 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:40.521856 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:40.522481 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:40.529265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:40.529742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:40.530764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:40.531210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:40.700639 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:40.719186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-60a1acbd-d3f2-4410-82a9-006e14a6835e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.199561 Jul 14 10:14:40.724858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 48/99] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:40 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:40.984053 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:40.984289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:40.984803 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:40.985190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:40.992276 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:40.992829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:40.993793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:40.994313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:40.994548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:40.995446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:40.996342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:40.997697 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:41.206443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:41.210983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:41.215697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8dab9dbb-63e5-498e-b040-96b69e7da375 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1366 microversion: 2.1 time: 0.235493 Jul 14 10:14:41.216908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 49/100] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:40 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:41.220254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c467c13d-67c8-44b9-a7e0-688ffe8d8165 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.240282 Jul 14 10:14:41.233427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 52/101] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:40 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:41.484277 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e65cb701-e347-46cf-8a76-9ece898c96d2"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:41.487776 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:41.495265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:41.496319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:41.497612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:41.498292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:41.739903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:41.745929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:41.768491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:41.768491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:41.768491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:41.768491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:42.112386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:42.124126 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-caaa6e15-0607-4e92-a01a-fb095de5384e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.388208 Jul 14 10:14:42.124803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 53/102] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:41 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:42.233983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:42.234776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:42.256225 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:42.257286 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:42.258075 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:42.258517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:42.485990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:42.494892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-049a45f2-dc33-4139-ab28-3852ad04c7cc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1556 microversion: 2.1 time: 0.264799 Jul 14 10:14:42.495695 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 54/103] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:42 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:42.504434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:42.505642 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:42.512446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:42.513001 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:42.513985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:42.514437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:42.702061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:42.710245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7a13ac07-4363-4003-914e-d1ae1bf51873 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.210259 Jul 14 10:14:42.711312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 55/104] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:42 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:42.726255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:42.726752 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:42.733584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:42.735178 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:42.735941 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:42.736377 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:43.097191 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3632d076-a196-402e-a64d-50c941a5b8c6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.375312 Jul 14 10:14:43.097859 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 56/105] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:14:42 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-interface => generated 285 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:43.141428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:43.142655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:43.150623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:43.151365 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:43.152598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:43.153236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:43.433355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:43.448317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-719da595-6098-456e-84ce-819ac63444b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.311176 Jul 14 10:14:43.450284 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 57/106] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:43 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:43.727586 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:43.728196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:43.735183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:43.735872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:43.736876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:43.737655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:43.995375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:44.021506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a2980f99-33f5-4478-be3b-e7838697347c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.297212 Jul 14 10:14:44.033377 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 58/107] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:43 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:44.466350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:44.467725 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:44.474126 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:44.474812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:44.476354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:44.476969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:44.692911 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:44.703521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b0353c13-9a24-4596-b973-aaf94799179f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.240898 Jul 14 10:14:44.715761 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 59/108] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:44 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:44.724356 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-58cb0161-dad9-46c0-8d20-a18639e347c9 req-cc045a38-71d7-4c97-910c-61fe4c737344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ac6d8d-492d-45da-ac13-5688fc6e2bb6", "tag": "81f609dc-8842-42ec-9605-22d13d78fb55"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:44.736154 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-58cb0161-dad9-46c0-8d20-a18639e347c9 req-cc045a38-71d7-4c97-910c-61fe4c737344 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:44.736968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-58cb0161-dad9-46c0-8d20-a18639e347c9 req-cc045a38-71d7-4c97-910c-61fe4c737344 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:44.752856 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-58cb0161-dad9-46c0-8d20-a18639e347c9 req-cc045a38-71d7-4c97-910c-61fe4c737344 service nova] Creating event network-changed:81f609dc-8842-42ec-9605-22d13d78fb55 for instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 on hv-cinder-84980 Jul 14 10:14:44.760996 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-58cb0161-dad9-46c0-8d20-a18639e347c9 req-cc045a38-71d7-4c97-910c-61fe4c737344 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043727 Jul 14 10:14:44.762417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 60/109] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:45.041876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:45.041876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:45.052455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:45.057810 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:45.060232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:45.062053 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:45.552383 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:45.584893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-32a9bbda-cb61-47ed-b4c7-9e12eecbc074 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1363 microversion: 2.1 time: 0.548230 Jul 14 10:14:45.590669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 61/110] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:45 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1363 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:45.723056 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:45.723704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:45.735472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:45.735932 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:45.736729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:45.737217 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:45.977812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-59a38a2d-f782-4ee1-951a-8bc65482e55c tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "POST /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.497082 Jul 14 10:14:45.978741 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 50/111] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:14:41 2022] POST /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f/os-volume_attachments => generated 194 bytes in 4500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:46.303610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:46.312493 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-62db6104-b148-42ed-9584-69fe25badf41 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.594902 Jul 14 10:14:46.313102 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 62/112] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:45 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:14:46.605700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:46.608572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:46.626945 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:46.627672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:46.628174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:46.628619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:46.863530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:46.888278 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c8eb4ce8-6c1f-409d-971b-9ff0852b70be tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1550 microversion: 2.1 time: 0.287974 Jul 14 10:14:46.891317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 51/113] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:46 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1550 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:46.909903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:46.911086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:46.920132 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:46.920571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:46.922103 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:46.922706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:47.016135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-14a79547-a435-4cef-8d44-f5655b84a1fd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111568 Jul 14 10:14:47.016828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 63/114] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:14:46 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:47.331369 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:47.331974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:47.339296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:47.339747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:47.340507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:47.341146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:47.708015 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:47.726284 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cd935447-aa32-4bd7-a774-401bae8c1c3e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.399060 Jul 14 10:14:47.727235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 52/115] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:47 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:48.744432 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:48.745086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:48.755228 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:48.755695 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:48.756579 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:48.756981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:48.768379 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:48.976525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-718d24e4-2ee1-4899-aa66-26382b874db0 req-0baea83f-5a8b-41b3-88a3-1b5057571b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb5e53dd-665c-4eb7-a9b9-94555c21df75", "tag": "60884b85-920e-41c7-b0fe-f0bd7728bc60"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:48.994596 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-718d24e4-2ee1-4899-aa66-26382b874db0 req-0baea83f-5a8b-41b3-88a3-1b5057571b06 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:48.999908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-718d24e4-2ee1-4899-aa66-26382b874db0 req-0baea83f-5a8b-41b3-88a3-1b5057571b06 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:49.024521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-718d24e4-2ee1-4899-aa66-26382b874db0 req-0baea83f-5a8b-41b3-88a3-1b5057571b06 service nova] Creating event network-changed:60884b85-920e-41c7-b0fe-f0bd7728bc60 for instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 on hv-cinder-84980 Jul 14 10:14:49.033903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-718d24e4-2ee1-4899-aa66-26382b874db0 req-0baea83f-5a8b-41b3-88a3-1b5057571b06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061937 Jul 14 10:14:49.040055 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 53/116] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:14:49.047136 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:49.060211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7ff67a6c-96eb-4726-9285-ac0346cba872 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.318306 Jul 14 10:14:49.063137 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 64/117] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:48 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:50.081351 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:50.082111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:50.096891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:50.097739 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:50.100779 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:50.101892 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:50.481286 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:50.500064 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-64ef08fa-3616-48f6-bb23-094a4ecb8594 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.424579 Jul 14 10:14:50.510347 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 54/118] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:50 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:51.525586 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:51.527840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:51.538388 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:51.544329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:51.546765 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:51.547408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:52.081173 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:52.100793 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-cad61bba-8bf0-4749-8ffa-ee9931b60275 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.579098 Jul 14 10:14:52.101449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 65/119] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:51 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:53.119504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:53.120211 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:53.133588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:53.134298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:53.135231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:53.135837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:53.393761 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:53.407964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6cd61f12-5416-48c5-bff7-6524fd917950 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.293762 Jul 14 10:14:53.409030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 55/120] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:53 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:54.425375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:54.425985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:54.428046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=77 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:54.434409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:54.434863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:54.435643 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:54.436081 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:54.645785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:54.654585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-afb77e13-2c1e-45da-9e0d-55bd0d1d1b38 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.233029 Jul 14 10:14:54.655766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 66/121] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:54 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:55.010464 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dd02a96e-e5a5-4f5c-816f-50f251c3ea70 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Action: 'create', calling method: .version_select at 0x7f5625b49c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-39123578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAADgWE1dxbW/yJthPuiQbN/XPtngJdHh8Evr0pdVNHETH1h07HJuRo2sxzcrYlocTPQX1cUNl+jtta+nWuSv/X3XFvJuL7EsGTeHzbU7qpgG5AzviWLvbNEf/Qex/NlNg=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:14:55.025124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-dd02a96e-e5a5-4f5c-816f-50f251c3ea70 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Getting quotas for project da859b6d410b4c2b995804fa5ffd190f. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:14:55.029474 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-dd02a96e-e5a5-4f5c-816f-50f251c3ea70 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Getting quotas for user 3f37d419e37b4172b27649775a144ca6 and project da859b6d410b4c2b995804fa5ffd190f. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:14:55.052442 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dd02a96e-e5a5-4f5c-816f-50f251c3ea70 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.215319 Jul 14 10:14:55.053101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 56/122] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:14:54 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:14:55.671887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:55.672506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:55.679376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:55.679951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:55.680792 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:55.681214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:55.832025 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:55.841981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-453f995c-87b6-4c7b-978a-923409e3e622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.173770 Jul 14 10:14:55.842314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 67/123] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:55 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:56.858852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:56.859384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:56.866499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:56.866983 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:56.867750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:56.868193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:56.996682 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:57.004232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4f38edb9-9ca1-42e7-8def-363e610d80ac tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.149330 Jul 14 10:14:57.005131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 57/124] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:56 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:58.021280 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:58.022481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:58.029840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:58.030376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:58.031122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:58.031713 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:58.182211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:58.189707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-830a351e-c34c-4f4e-a556-0f3fc71b3f35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.172414 Jul 14 10:14:58.190277 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 68/125] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:58 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:14:59.209931 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:14:59.211718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:14:59.215329 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:59.224692 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:59.225378 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:59.226568 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:14:59.227203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:14:59.385441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:14:59.389003 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:14:59.394563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-785bc465-be3d-4bc1-829e-18a50ee10622 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.190268 Jul 14 10:14:59.395158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 58/126] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:14:59 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:00.412974 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:00.413763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:00.422552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.423280 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:00.424526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.425218 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:00.592609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:00.593168 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:00.609160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.609945 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:00.611026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.611643 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:00.640556 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:15:00.678356 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:00.687281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-469edcae-2282-46f9-a34c-c0a3d5d0b800 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.279130 Jul 14 10:15:00.688373 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 69/127] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:00 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:00.773448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-48089e7d-433b-4d33-98d6-252977bed233 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 204 len: 0 microversion: 2.1 time: 0.187898 Jul 14 10:15:00.774433 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 59/128] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:15:00 2022] DELETE /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:15:00.783388 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:00.784283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:00.791441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.791983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:00.792892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:00.793442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:01.018731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:01.030629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e2c1f976-7d1b-470d-aacf-0e18f6b3e384 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.251589 Jul 14 10:15:01.031715 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 70/129] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:00 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:01.706257 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:01.707808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:01.716146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:01.716597 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:01.717426 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:01.717850 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:01.878700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:01.887471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-76d80198-04bc-407c-b867-7dac8560bac4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.187386 Jul 14 10:15:01.888252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 60/130] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:01 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:02.050515 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:02.051448 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:02.059486 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:02.060330 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:02.061221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:02.061919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:02.207317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:02.217494 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-01dcaa27-fec7-44e6-9eb2-fdf78c556c5e tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.173807 Jul 14 10:15:02.218247 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 71/131] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:02 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:02.903720 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:02.904323 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:02.910774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:02.911221 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:02.911972 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:02.913082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:03.043629 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:03.051063 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3a4eabee-b3a3-4b40-8b2d-7631b6e2f05c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.151446 Jul 14 10:15:03.051631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 61/132] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:02 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:03.234840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:03.235455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:03.242090 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:03.242544 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:03.243314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:03.243759 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:03.372546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:03.380472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a814a6bb-35d6-44c4-ac95-8a61566180e0 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.149520 Jul 14 10:15:03.381051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 72/133] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:03 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:04.068356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:04.069094 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:04.075466 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:04.075918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:04.076686 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:04.077167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:04.206321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:04.215361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-28fbd7ec-8f33-439e-9752-a94b39ab09ff tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.151055 Jul 14 10:15:04.215938 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 62/134] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:04 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:04.397573 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:04.398192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:04.404677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:04.405112 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:04.405880 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:04.406320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:04.544956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:04.553460 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6a695623-870e-40bc-a7f5-493f563fa24a tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.160075 Jul 14 10:15:04.554169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 73/135] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:04 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:05.233121 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:05.233667 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:05.239837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=4 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:05.242031 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.242488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.243272 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.243714 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.376388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:05.383948 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-572b6113-d1a0-4492-8c80-0f406e17a3d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.154828 Jul 14 10:15:05.384520 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 63/136] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:05 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:05.570829 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:05.572254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:05.578761 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.579216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.580171 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:05.580573 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:05.710274 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:05.718213 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-eada852b-aed1-47c7-93ec-9ac0f6dbe5cf tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.152538 Jul 14 10:15:05.718776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 74/137] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:05 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:06.400239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:06.400844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:06.408311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.408754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.409539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.410232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.540453 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:06.548067 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-20a0aefe-49b5-4f3b-9cb4-3314cdbe44dd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.151667 Jul 14 10:15:06.548634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 64/138] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:06 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:06.735019 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:06.735640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:06.741770 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.742223 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.742984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:06.743420 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:06.875159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:06.882958 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-af4ea0c6-3b42-4e9f-b29d-0f7412b10354 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.151773 Jul 14 10:15:06.883523 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 75/139] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:06 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:07.565822 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:07.566394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:07.572850 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.573330 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:07.574095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.574535 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:07.721519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:07.728855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5bec51d0-6137-450d-8dd9-e72293703543 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.167106 Jul 14 10:15:07.729485 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 65/140] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:07 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:07.899376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:07.899982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:07.906315 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.906768 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:07.907528 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:07.907966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:08.039076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:08.047105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ebf01582-2e06-423c-8c0e-f2c25be19129 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.151610 Jul 14 10:15:08.047672 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 76/141] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:07 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:08.748541 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:08.750100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:08.765249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:08.765740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:08.766621 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:08.767131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:08.917698 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:08.926507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b3564c54-5668-4031-9027-f862bec969d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.183899 Jul 14 10:15:08.927288 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 66/142] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:08 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:09.065740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:09.066368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:09.073603 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:09.074069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:09.074877 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:09.075336 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:09.228439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:09.236496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3ca141f2-5ae2-4b37-a080-eb37d89ec523 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1553 microversion: 2.1 time: 0.174632 Jul 14 10:15:09.237473 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 77/143] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:09 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:09.503596 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-bda3eae3-1512-47ab-bafe-3ef3fea01109 req-0969a95b-0fd9-4afc-8430-4c1daa8b2475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafa60f3-c1a7-4417-86cc-18991a61e82f", "name": "network-vif-deleted", "tag": "ce5d7280-4a51-4c65-ac60-5e8730133d1a"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:09.523622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-bda3eae3-1512-47ab-bafe-3ef3fea01109 req-0969a95b-0fd9-4afc-8430-4c1daa8b2475 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:09.524061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-bda3eae3-1512-47ab-bafe-3ef3fea01109 req-0969a95b-0fd9-4afc-8430-4c1daa8b2475 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:09.535983 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-bda3eae3-1512-47ab-bafe-3ef3fea01109 req-0969a95b-0fd9-4afc-8430-4c1daa8b2475 service nova] Creating event network-vif-deleted:ce5d7280-4a51-4c65-ac60-5e8730133d1a for instance fafa60f3-c1a7-4417-86cc-18991a61e82f on hv-cinder-84980 Jul 14 10:15:09.542157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-bda3eae3-1512-47ab-bafe-3ef3fea01109 req-0969a95b-0fd9-4afc-8430-4c1daa8b2475 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041985 Jul 14 10:15:09.543390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 67/144] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:09.947568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:09.948375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:09.955796 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:09.956541 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:09.960423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:09.961109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.140875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:10.148720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9d908a7d-b9f2-429b-b918-46322af9db1a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.207539 Jul 14 10:15:10.149427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 78/145] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:09 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:10.255280 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:10.255987 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:10.262613 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:10.263097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.263907 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:10.264327 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.296187 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:10.296701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:10.297118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lazy-loading 'fault' on Instance uuid fafa60f3-c1a7-4417-86cc-18991a61e82f {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:10.346193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fed44db7dc014719b5ed0399c715435b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5b4dfcb90d421192be6dbc102ca1bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:10.356722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2a1507ed-b73a-4edd-9f91-db7c9f9cd305 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 200 len: 1350 microversion: 2.1 time: 0.106169 Jul 14 10:15:10.357723 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 68/146] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:10 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 1350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:11.166884 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:11.167428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:11.173064 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.173497 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.174423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.174857 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.367752 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:11.376453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4530cbd4-158f-4dc9-a0da-427d8cae7c3f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.214467 Jul 14 10:15:11.376849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:11.377431 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:11.377592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 79/147] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:11 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:11.387812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.388977 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.389921 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.390372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.405825 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] HTTP exception thrown: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Request method failure captured: Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f HTTP/1.1 Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xjVmQucSpY5VZECqk9BxDj2tzdc4GK1kjFYXSoUSx5njwWhLBiKagSGG5ccvDqV49Vkic5nQReHSp6wAXWQHu50ZVKiZGsb5iwox7GqfB6CTpwMzM12rupD08UdVxib6DXjs-FTAIuo32gf4it_HxB94qgi5yEk0dluQEI9EFuVqc Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:15:11.418022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a5b4dfcb90d421192be6dbc102ca1bb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: fed44db7dc014719b5ed0399c715435b Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.419515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'fafa60f3-c1a7-4417-86cc-18991a61e82f'} Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:11.420350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.421755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.422922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Returning 404 to user: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:11.422922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4cb2e311-e42d-4fa3-a193-6ae730327de5 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 404 len: 111 microversion: 2.1 time: 0.050038 Jul 14 10:15:11.425097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 69/148] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:11 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:15:11.561244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:11.562223 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:11.573347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.574176 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.575077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:11.575677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:11.593308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] HTTP exception thrown: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Request method failure captured: Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f/os-volume_attachments HTTP/1.1 Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xjVmQucSpY5VZECqk9BxDj2tzdc4GK1kjFYXSoUSx5njwWhLBiKagSGG5ccvDqV49Vkic5nQReHSp6wAXWQHu50ZVKiZGsb5iwox7GqfB6CTpwMzM12rupD08UdVxib6DXjs-FTAIuo32gf4it_HxB94qgi5yEk0dluQEI9EFuVqc Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:15:11.605354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a5b4dfcb90d421192be6dbc102ca1bb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: fed44db7dc014719b5ed0399c715435b Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.606525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'server_id': 'fafa60f3-c1a7-4417-86cc-18991a61e82f'} Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:11.607175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:11.608207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:11.609399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Returning 404 to user: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:11.609399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2bfc62a5-3a4c-47db-8d2a-bcbae3b83d97 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049614 Jul 14 10:15:11.609399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 80/149] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:15:11 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:15:12.394572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:12.395105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:12.403956 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:12.404383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:12.405285 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:12.406005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:12.619453 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:12.629592 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3649d0f5-9fda-41a3-8e8b-e2b3dcd62ea5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.238724 Jul 14 10:15:12.630862 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 70/150] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:12 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:13.013543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:13.014616 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:13.021014 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:13.021534 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:13.022334 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:13.022782 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:13.038271 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] HTTP exception thrown: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Request method failure captured: Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f HTTP/1.1 Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xjVmQucSpY5VZECqk9BxDj2tzdc4GK1kjFYXSoUSx5njwWhLBiKagSGG5ccvDqV49Vkic5nQReHSp6wAXWQHu50ZVKiZGsb5iwox7GqfB6CTpwMzM12rupD08UdVxib6DXjs-FTAIuo32gf4it_HxB94qgi5yEk0dluQEI9EFuVqc Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:15:13.040495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a5b4dfcb90d421192be6dbc102ca1bb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: fed44db7dc014719b5ed0399c715435b Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.041776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'fafa60f3-c1a7-4417-86cc-18991a61e82f'} Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:13.042468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.046640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.047995 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Returning 404 to user: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:13.047995 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c4b65538-4996-4d2f-8774-b458a215d111 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 404 len: 111 microversion: 2.1 time: 0.032380 Jul 14 10:15:13.047995 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 81/151] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:15:13 2022] DELETE /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:15:13.050729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:13.051390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] [instance: fafa60f3-c1a7-4417-86cc-18991a61e82f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:13.058396 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:13.058768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:13.059627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:13.060070 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:13.075870 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] HTTP exception thrown: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Request method failure captured: Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f HTTP/1.1 Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xjVmQucSpY5VZECqk9BxDj2tzdc4GK1kjFYXSoUSx5njwWhLBiKagSGG5ccvDqV49Vkic5nQReHSp6wAXWQHu50ZVKiZGsb5iwox7GqfB6CTpwMzM12rupD08UdVxib6DXjs-FTAIuo32gf4it_HxB94qgi5yEk0dluQEI9EFuVqc Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:15:13.077740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7a5b4dfcb90d421192be6dbc102ca1bb", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7a5b4dfcb90d421192be6dbc102ca1bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 7a5b4dfcb90d421192be6dbc102ca1bb Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-DeleteServersTestJSON-251682846 Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: fed44db7dc014719b5ed0399c715435b Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-DeleteServersTestJSON-251682846-project Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.079177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'fafa60f3-c1a7-4417-86cc-18991a61e82f'} Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:13.079879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. Jul 14 10:15:13.081260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:15:13.082395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] Returning 404 to user: Instance fafa60f3-c1a7-4417-86cc-18991a61e82f could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:13.082395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6b3c2549-f009-4e13-9ea6-69960bace531 tempest-DeleteServersTestJSON-251682846 tempest-DeleteServersTestJSON-251682846-project] 10.222.0.61 "GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f" status: 404 len: 111 microversion: 2.1 time: 0.032685 Jul 14 10:15:13.085149 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 71/152] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:13 2022] GET /compute/v2.1/servers/fafa60f3-c1a7-4417-86cc-18991a61e82f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:15:13.648340 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:13.648866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:13.655349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:13.655809 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:13.656577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:13.657047 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:13.660990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:13.788993 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:13.796743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3a28130a-4e3e-4a70-ae68-4b562f31275b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.152869 Jul 14 10:15:13.797445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 82/153] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:13 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:14.205887 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1077484095", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "networks": [{"uuid": "32aecae8-1c1b-45b6-9257-4f2ea89e12f3"}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:14.265127 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] validate_networks() for [('32aecae8-1c1b-45b6-9257-4f2ea89e12f3', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:15:14.643939 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:15:14.644384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:15:14.645068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:15:14.645465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:15:14.645880 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:15:14.655594 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:14.656045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:14.656839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:14.657303 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:14.674261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Getting quotas for project f523b9be668a4dc69619027cec280a08. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:15:14.678747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Getting quotas for user 5298be027cf843638957c4a15003db7f and project f523b9be668a4dc69619027cec280a08. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:15:14.690147 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:15:14.692759 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:15:14.737718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7cc22d80-c393-40b4-b407-bc3160c82c17 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535880 Jul 14 10:15:14.738955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 72/154] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:15:14.749335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-52baeccf-edfc-4f0d-b682-22488612cee3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:14.750069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-52baeccf-edfc-4f0d-b682-22488612cee3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:14.813940 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:14.814846 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:14.845297 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-52baeccf-edfc-4f0d-b682-22488612cee3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:14.845497 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:14.846041 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:14.846820 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:14.847157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:14.853997 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-52baeccf-edfc-4f0d-b682-22488612cee3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1214 microversion: 2.1 time: 0.108659 Jul 14 10:15:14.854580 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 83/155] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:14 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:15.028322 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:15.039851 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9a5e28ef-7256-4c02-b75f-2c2380f310d5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.226901 Jul 14 10:15:15.039944 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 73/156] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:14 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:15.872107 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:15.872847 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:15.880457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:15.881782 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:15.882578 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:15.883021 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:16.056748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:16.057523 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:16.064796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:16.065380 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:16.066238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:16.066753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:16.196684 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:16.205091 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5275a508-ef8b-4daf-95a9-5ccfd36d6a0f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1266 microversion: 2.1 time: 0.337426 Jul 14 10:15:16.205670 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 84/157] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:15 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1266 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:16.329070 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:16.338589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c9cb4dfa-e788-425c-966d-38e8e19fcd4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.286644 Jul 14 10:15:16.339173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 74/158] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:16 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:17.222041 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:17.222763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:17.228908 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:17.229436 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:17.230206 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:17.230643 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:17.299433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:17.307635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c641a7a7-7f47-496b-882f-41ed7c888047 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1266 microversion: 2.1 time: 0.089388 Jul 14 10:15:17.308136 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 85/159] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:17 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:17.355448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:17.356050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:17.362359 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:17.362804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:17.363557 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:17.363985 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:17.494942 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:17.502431 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a3a43308-1279-413c-a147-0e4c110a7182 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.150718 Jul 14 10:15:17.503026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 75/160] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:17 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:18.324288 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:18.324801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:18.330916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:18.331367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:18.332140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:18.332584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:18.396776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:18.404638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8de757d7-7dab-4dcc-8364-18ef082193e9 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1266 microversion: 2.1 time: 0.084355 Jul 14 10:15:18.405243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 86/161] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:18 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:18.520087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:18.521061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:18.528108 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:18.528639 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:18.529507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:18.530056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:18.534225 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:18.669705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:18.677219 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-78896b89-e14b-4bab-bdf3-f4ff090b2ae8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.160913 Jul 14 10:15:18.677794 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 76/162] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:18 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:19.423470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:19.424287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:19.436003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:19.437177 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:19.437959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:19.438913 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:19.507610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:19.515735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-94a73fdc-c853-433e-9f68-aa7edc99e35f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1272 microversion: 2.1 time: 0.097665 Jul 14 10:15:19.516390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 87/163] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:19 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:19.697318 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:19.697932 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:19.707551 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:19.708009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:19.708784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:19.709678 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:19.915504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:19.934774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-600735e3-94aa-4011-99c3-32441825f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.243597 Jul 14 10:15:19.945797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 77/164] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:19 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:20.534106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:20.534868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:20.544618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:20.545643 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:20.551045 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:20.551665 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:20.570848 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-e05718e9-a044-4e4b-846d-2a7dda72beeb req-0c6448a3-f668-4a88-8593-e249c071664f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ca1b3e2-2e14-4449-bf58-e115a8874374", "tag": "a997aa11-4b87-4ae9-9f8c-fd2247266cc2"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:20.592400 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-e05718e9-a044-4e4b-846d-2a7dda72beeb req-0c6448a3-f668-4a88-8593-e249c071664f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:20.592851 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-e05718e9-a044-4e4b-846d-2a7dda72beeb req-0c6448a3-f668-4a88-8593-e249c071664f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:20.605459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-e05718e9-a044-4e4b-846d-2a7dda72beeb req-0c6448a3-f668-4a88-8593-e249c071664f service nova] Creating event network-changed:a997aa11-4b87-4ae9-9f8c-fd2247266cc2 for instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 on hv-cinder-84980 Jul 14 10:15:20.610916 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-e05718e9-a044-4e4b-846d-2a7dda72beeb req-0c6448a3-f668-4a88-8593-e249c071664f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045105 Jul 14 10:15:20.611939 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 78/165] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:15:20.707497 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:20.715746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-444c9e48-11f8-4537-93a8-8b4782914dda tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.185949 Jul 14 10:15:20.716407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 88/166] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:20 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:20.963169 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:20.964126 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:20.971416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:20.975988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:20.976844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:20.977324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:21.127233 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:21.135282 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e32f49d4-bf2b-485c-bbad-250164988ace tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.177022 Jul 14 10:15:21.135851 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 79/167] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:20 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:21.733141 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:21.733738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:21.739671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:21.741324 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:21.742321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:21.742757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:21.874036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:21.881798 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1aa5a977-a71c-46bf-84dc-d88bf8dac9d3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.152586 Jul 14 10:15:21.882507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 89/168] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:21 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:22.152631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:22.153307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:22.159787 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:22.160242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:22.161042 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:22.161491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:22.312325 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:22.320649 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e8f1ecfa-aab3-4ee4-a259-99e29590b7d1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.172453 Jul 14 10:15:22.321441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 80/169] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:22 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:22.899993 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:22.901491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:22.909629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:22.910314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:22.911316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:22.911959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:23.108122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:23.117738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d17f6df5-ea34-45ee-b954-264c924ee5b8 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.222621 Jul 14 10:15:23.118416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 90/170] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:22 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:23.338902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:23.339454 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:23.346582 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:23.347039 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:23.347893 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:23.348355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:23.489127 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:23.497160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3d013e65-7619-4fdb-b122-976c8af5c038 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.163105 Jul 14 10:15:23.497745 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 81/171] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:23 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:24.108630 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1402515854", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-39123578", "security_groups": [{"name": "tempest-secgroup-smoke-221949195"}], "networks": [{"uuid": "4f292b1d-6753-429c-8af0-15033bed0b5f"}], "block_device_mapping_v2": [{"uuid": "f4b6487e-1444-4ade-8532-90f613537731", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:24.136661 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:24.137314 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:24.147655 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:24.148111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:24.150765 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:24.151212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:24.275020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] validate_networks() for [('4f292b1d-6753-429c-8af0-15033bed0b5f', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:15:24.387443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:24.398416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a4ec04e2-31b3-4f25-bea6-4682f7df3de4 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.265681 Jul 14 10:15:24.399212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 82/172] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:24 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:24.514869 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:24.515892 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:24.522583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:24.523332 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=54 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:24.523801 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:24.524802 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:24.526242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:24.665147 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:24.685590 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=6 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:24.772836 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:24.784979 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a3c7ef6c-c43b-4039-a032-05cb059ce95b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.274140 Jul 14 10:15:24.785637 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 83/173] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:24 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:24.832035 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:15:24.832562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:15:24.833145 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:15:24.833543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:15:24.833952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:15:24.844190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:24.844956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:24.845758 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:24.846234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:24.865953 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Getting quotas for project da859b6d410b4c2b995804fa5ffd190f. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:15:24.869958 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Getting quotas for user 3f37d419e37b4172b27649775a144ca6 and project da859b6d410b4c2b995804fa5ffd190f. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:15:24.930808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:15:24.932879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f4b6487e-1444-4ade-8532-90f613537731',volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:15:25.065306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4c1861e8-bfc1-4e06-9e79-3d10c23c8f72 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.960669 Jul 14 10:15:25.065988 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 91/174] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:15:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:15:25.078847 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-af320540-5b80-4625-b6ca-a68295a44a89 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:25.079644 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-af320540-5b80-4625-b6ca-a68295a44a89 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:25.147616 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-af320540-5b80-4625-b6ca-a68295a44a89 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:25.154695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-af320540-5b80-4625-b6ca-a68295a44a89 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1087 microversion: 2.1 time: 0.081719 Jul 14 10:15:25.155272 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 84/175] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:25 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1087 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:25.417034 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:25.417690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:25.424340 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:25.426523 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:25.432323 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:25.432824 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:25.586740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:25.594292 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-48fea312-f119-4c5b-b680-0f48e2b86edc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.182334 Jul 14 10:15:25.594853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 92/176] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:25 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:25.804047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:25.804744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:25.818134 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:25.818632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:25.819432 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:25.819931 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:26.030773 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:26.049082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-01defa5f-f67f-4655-bfa4-8e0380af451e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1523 microversion: 2.1 time: 0.249600 Jul 14 10:15:26.051062 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 85/177] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:25 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:26.084453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-9deacfbc-4b35-40ec-8b9e-be0a0e386e1b req-7ec0f370-9b1e-4a14-b0d7-217e91694ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca1b3e2-2e14-4449-bf58-e115a8874374", "name": "network-vif-plugged", "status": "completed", "tag": "a997aa11-4b87-4ae9-9f8c-fd2247266cc2"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:26.094199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-9deacfbc-4b35-40ec-8b9e-be0a0e386e1b req-7ec0f370-9b1e-4a14-b0d7-217e91694ebc service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:26.094596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-9deacfbc-4b35-40ec-8b9e-be0a0e386e1b req-7ec0f370-9b1e-4a14-b0d7-217e91694ebc service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:26.107919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-9deacfbc-4b35-40ec-8b9e-be0a0e386e1b req-7ec0f370-9b1e-4a14-b0d7-217e91694ebc service nova] Creating event network-vif-plugged:a997aa11-4b87-4ae9-9f8c-fd2247266cc2 for instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 on hv-cinder-84980 Jul 14 10:15:26.113031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-9deacfbc-4b35-40ec-8b9e-be0a0e386e1b req-7ec0f370-9b1e-4a14-b0d7-217e91694ebc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033339 Jul 14 10:15:26.113634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 93/178] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:26.171701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:26.172304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:26.178575 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:26.179033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:26.179831 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:26.180269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:26.250241 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:26.261247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b46b9e5e-631b-4e8a-a0b5-0fe0c8dad176 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1185 microversion: 2.1 time: 0.093230 Jul 14 10:15:26.262119 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 86/179] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:26 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:26.611523 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:26.612253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:26.618605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:26.619049 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:26.619808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:26.620237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:26.797959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:26.805520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-511c1f06-1359-46c2-aca7-aa54d4d86531 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.198174 Jul 14 10:15:26.806135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 94/180] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:26 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:27.070858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:27.072680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:27.080295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.080739 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.081715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.082152 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.258049 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:27.267045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e7c559f4-a98d-4eb0-b9e3-8f6271dd9fba tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1503 microversion: 2.1 time: 0.203357 Jul 14 10:15:27.267797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 87/181] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:27 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:27.279453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:27.279453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:27.298316 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:27.299154 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:27.307497 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.308413 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.309552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.310279 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.316149 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.317521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.318876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.319935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.431922 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:27.445816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-dc8e3f19-39d1-451f-92b4-9ac5809b289a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1193 microversion: 2.1 time: 0.170729 Jul 14 10:15:27.446429 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 95/182] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:27 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1193 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:27.511235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:27.519153 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6502a0b2-f4a5-4a75-beb7-25427b348808 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1516 microversion: 2.1 time: 0.225101 Jul 14 10:15:27.519739 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 88/183] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:27 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:27.822614 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:27.823957 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:27.837246 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.837708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:27.838572 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:27.839776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:28.103414 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:28.112834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ccf51ffc-8d3e-47ea-a679-d96c9a3bc0b3 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1314 microversion: 2.1 time: 0.294296 Jul 14 10:15:28.113645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 96/184] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:27 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:28.464390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:28.465000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:28.478360 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:28.481350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:28.482200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:28.491554 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:28.721056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:28.729577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b108c546-4604-40dd-b3e0-ebfb5e964a3b tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1270 microversion: 2.1 time: 0.269820 Jul 14 10:15:28.730446 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 89/185] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:28 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:29.132152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:29.133560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:29.143122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.143777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.144558 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.145024 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.319699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:29.320709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:29.329424 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:29.332256 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.335233 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.336372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.336998 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.343273 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:29.355920 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e70c64cf-1e6d-4519-a52d-573cf97beecb tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1498 microversion: 2.1 time: 0.229386 Jul 14 10:15:29.356729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 97/186] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:29 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1498 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:29.375038 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-1dd73ff8-7cfa-4eb0-b71e-89014672da71 req-6849a407-5422-444f-b1d6-ccf2e6669827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:29.410916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-1dd73ff8-7cfa-4eb0-b71e-89014672da71 req-6849a407-5422-444f-b1d6-ccf2e6669827 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.411727 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-1dd73ff8-7cfa-4eb0-b71e-89014672da71 req-6849a407-5422-444f-b1d6-ccf2e6669827 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.432542 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-1dd73ff8-7cfa-4eb0-b71e-89014672da71 req-6849a407-5422-444f-b1d6-ccf2e6669827 service nova] Creating event network-changed:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:15:29.442851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-1dd73ff8-7cfa-4eb0-b71e-89014672da71 req-6849a407-5422-444f-b1d6-ccf2e6669827 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084445 Jul 14 10:15:29.444085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 98/187] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:29.567460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lazy-loading 'flavor' on Instance uuid 0afff4cc-eaa2-4da3-8511-45d0b306c539 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:29.677625 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fafcd7c3-b28d-468e-ab07-5552d783ccca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/action" status: 200 len: 32 microversion: 2.1 time: 0.361221 Jul 14 10:15:29.678958 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 90/188] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:15:29 2022] POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 10:15:29.689055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:29.690696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:29.700315 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.701250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.702518 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.703610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.749226 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:29.750092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:29.762999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.764938 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.766846 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:29.769597 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:29.927621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:29.941634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0e64ea18-9b46-4e3d-b352-dffec13bb9a4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.256672 Jul 14 10:15:29.942419 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 99/189] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:29 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:29.994398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:30.005030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-33f307a9-abd5-416e-9ffb-4ab43a4ff207 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.258938 Jul 14 10:15:30.006072 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 91/190] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:29 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:30.110766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:30.111270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:30.117544 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:30.118907 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:30.119921 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:30.120575 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:30.151657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:15:30.195209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:30.273517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6442a939-014a-4c0b-b8c9-ae91f4579c91 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 204 len: 0 microversion: 2.1 time: 0.166558 Jul 14 10:15:30.274111 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 100/191] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:15:30 2022] DELETE /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:15:30.282446 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:30.283109 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:30.289399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:30.289845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:30.290617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:30.291046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:30.311455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:30.442620 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:30.457001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-59d5206a-3709-4ec9-a04b-ca2db5b725d0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1504 microversion: 2.1 time: 0.177874 Jul 14 10:15:30.460634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 92/192] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:30 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:30.959602 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:30.960329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:30.966840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:30.967290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:30.968055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:30.968491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:31.022643 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:31.023255 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:31.030484 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:31.030970 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:31.031743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:31.032383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:31.176747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:31.185364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d9f37f4d-0a7f-4a97-9375-fa2b252bd202 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.230004 Jul 14 10:15:31.186247 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 101/193] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:30 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:31.216991 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:31.226028 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6d50606d-7188-4a50-bc54-cdd00ad790cf tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.207658 Jul 14 10:15:31.226607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 93/194] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:31 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:31.477638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:31.478444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:31.484878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:31.485348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:31.486101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:31.486530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:31.634259 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:31.643437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3340cf1a-610f-4944-9e6f-7447106d694c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1504 microversion: 2.1 time: 0.170512 Jul 14 10:15:31.644135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 102/195] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:31 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:32.204238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:32.205670 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:32.216006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:32.217927 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:32.221004 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:32.221662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:32.258176 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:32.260086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:32.273332 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:32.273999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:32.274914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:32.275536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:32.656482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:32.665046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-88f78954-c778-4ec9-ab72-ce1bd5b04949 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.464795 Jul 14 10:15:32.666725 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:32.674444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 94/196] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:32 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:32.677308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-79af1db8-fe59-4261-b133-95f453a39e6e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.431025 Jul 14 10:15:32.678859 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 103/197] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:32 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:32.688052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:32.688052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:32.688052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:32.688052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:32.688462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:32.688462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:32.901668 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:32.909963 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-304cadee-e4cc-44dc-a1be-f471d6399003 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1504 microversion: 2.1 time: 0.234306 Jul 14 10:15:32.910760 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 95/198] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:32 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:33.031536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-a5a8800d-2d1f-43fc-9881-723b2880cd83 req-5f87348c-6875-4149-9564-9376b650b1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ca1b3e2-2e14-4449-bf58-e115a8874374", "name": "network-vif-deleted", "tag": "a997aa11-4b87-4ae9-9f8c-fd2247266cc2"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:33.041092 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a5a8800d-2d1f-43fc-9881-723b2880cd83 req-5f87348c-6875-4149-9564-9376b650b1c8 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.041536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a5a8800d-2d1f-43fc-9881-723b2880cd83 req-5f87348c-6875-4149-9564-9376b650b1c8 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.054669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-a5a8800d-2d1f-43fc-9881-723b2880cd83 req-5f87348c-6875-4149-9564-9376b650b1c8 service nova] Creating event network-vif-deleted:a997aa11-4b87-4ae9-9f8c-fd2247266cc2 for instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 on hv-cinder-84980 Jul 14 10:15:33.061295 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-a5a8800d-2d1f-43fc-9881-723b2880cd83 req-5f87348c-6875-4149-9564-9376b650b1c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033942 Jul 14 10:15:33.061888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 104/199] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:33.681712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:33.682324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:33.690774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.691520 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.692304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.693041 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.696388 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:33.697230 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:33.717587 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.718043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.719077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.719521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.908516 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:33.924009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-170459df-c837-49f9-834a-7eaafd30fa35 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.245178 Jul 14 10:15:33.925665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 96/200] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:33 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:33.932899 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:33.934843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:33.942972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:33.945339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.946445 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.949957 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:33.951253 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:33.956370 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3f5425d2-d3dd-4777-90a2-9a09f13bdc4d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.263892 Jul 14 10:15:33.957051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 105/201] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:33 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:34.005172 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:34.006715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:34.007347 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lazy-loading 'fault' on Instance uuid 7ca1b3e2-2e14-4449-bf58-e115a8874374 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:34.059511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:34.067010 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2789f92c-1c7b-406a-9d18-be1ff55f4f50 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 200 len: 1304 microversion: 2.1 time: 0.139765 Jul 14 10:15:34.067817 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 97/202] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:33 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:34.941806 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:34.942420 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:34.944394 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:34.945086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=8 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:34.961746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:34.962657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:34.963449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:34.963888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:34.976256 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:34.977525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:34.984732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:34.985456 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:34.986394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:34.986988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:35.154951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:35.238333 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:35.246712 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4bd44e06-8f12-432b-86c8-2894fc791cb9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.308594 Jul 14 10:15:35.247766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 106/203] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:34 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:35.253225 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:35.254015 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: 7ca1b3e2-2e14-4449-bf58-e115a8874374] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:35.257349 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:35.260318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:35.260999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:35.261936 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:35.262377 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:35.265783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-16b74a93-1fd1-4b90-b0ee-bfd047f47f09 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.294799 Jul 14 10:15:35.267882 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 98/204] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:34 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:35.277395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] HTTP exception thrown: Instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 could not be found. Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Request method failure captured: Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 HTTP/1.1 Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-ywUOLCa6Vc0LlUszSqi9NoKCLlHq5yAedcZ1Azpi5K5m3CGnIjgUzGKH1Opy0gpIaSB9MVnQuf5ILCioFVfhMRGB0qrY_J4IBf1Y7oF6Ah32nWBO60sHZhNqtcM4IhLC088El41EBHFToIVEAH1DHljOvwAFJU1Faj53aQqC38OlY Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: f523b9be668a4dc69619027cec280a08 Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesActionsTest-1384045112 Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:15:35.279032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f523b9be668a4dc69619027cec280a08", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f523b9be668a4dc69619027cec280a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f523b9be668a4dc69619027cec280a08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f523b9be668a4dc69619027cec280a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesActionsTest-1384045112 Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: f523b9be668a4dc69619027cec280a08 Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesActionsTest-1384045112 Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesActionsTest-1384045112-project Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 5298be027cf843638957c4a15003db7f Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesActionsTest-1384045112-project Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 could not be found. Jul 14 10:15:35.280421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '7ca1b3e2-2e14-4449-bf58-e115a8874374'} Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 could not be found. Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:35.281265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 could not be found. Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 could not be found. Jul 14 10:15:35.282577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:35.283697 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Returning 404 to user: Instance 7ca1b3e2-2e14-4449-bf58-e115a8874374 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:35.283697 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fcc9752a-fef1-4063-8236-ad6a09a58cbe tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374" status: 404 len: 111 microversion: 2.1 time: 0.031262 Jul 14 10:15:35.284255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 107/205] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:35 2022] GET /compute/v2.1/servers/7ca1b3e2-2e14-4449-bf58-e115a8874374 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:15:35.386111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1501815125", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "networks": [{"uuid": "32aecae8-1c1b-45b6-9257-4f2ea89e12f3"}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:35.438132 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] validate_networks() for [('32aecae8-1c1b-45b6-9257-4f2ea89e12f3', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:15:36.007592 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:15:36.008134 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:15:36.008489 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:15:36.009093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:15:36.009674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:15:36.024071 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:36.024610 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:36.025360 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:36.025916 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:36.045170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Getting quotas for project f523b9be668a4dc69619027cec280a08. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:15:36.049522 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Getting quotas for user 5298be027cf843638957c4a15003db7f and project f523b9be668a4dc69619027cec280a08. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:15:36.062481 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:15:36.065068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:15:36.130324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e53c6c31-4e8b-429f-aa7d-76dbc464867b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747578 Jul 14 10:15:36.132740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 99/206] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:15:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:15:36.145244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0348e6d2-191e-4cf3-9b50-904d013d070b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:36.145863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0348e6d2-191e-4cf3-9b50-904d013d070b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:36.247801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0348e6d2-191e-4cf3-9b50-904d013d070b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:36.260628 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0348e6d2-191e-4cf3-9b50-904d013d070b tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1214 microversion: 2.1 time: 0.120916 Jul 14 10:15:36.261892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 108/207] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:36 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1214 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:36.270812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:36.270812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:36.281164 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:36.281862 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:36.283270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:36.283810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:36.284946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:36.290308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:36.301525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:36.301992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:36.306293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:36.306764 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:36.496124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:36.508537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c18b15af-eb2a-4935-86cd-bb7ec5166f31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.248380 Jul 14 10:15:36.518032 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 100/208] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:36 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:36.536635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:36.545070 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-415e279a-ce17-4d69-962e-374989f0832e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.264622 Jul 14 10:15:36.547112 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 109/209] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:36 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:37.278257 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:37.278872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:37.285308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:37.285765 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:37.286532 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:37.287469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:37.356593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:37.365023 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fd14939c-2fa8-4a65-9920-453428e1af4c tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1266 microversion: 2.1 time: 0.090783 Jul 14 10:15:37.366587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 101/210] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:37 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:37.526134 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:37.526886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:37.533678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:37.534229 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:37.535064 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:37.535597 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:37.568746 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:37.574642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:37.584451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:37.585146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:37.585944 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:37.586388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:37.827967 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:37.835872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fdabdbfc-649e-465d-bc41-f420e1aede31 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.313868 Jul 14 10:15:37.837015 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 110/211] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:37 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:37.851607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:37.859438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b3036fb4-2444-44fd-81b8-f2a0b9a7cc86 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.299643 Jul 14 10:15:37.859994 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 102/212] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:37 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:38.054762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-a6279b0f-89fd-4e4b-95bd-1778fb17daa9 req-061c509e-9e5a-4ec1-b970-c9090fd76ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "name": "network-vif-plugged", "status": "completed", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:38.067297 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a6279b0f-89fd-4e4b-95bd-1778fb17daa9 req-061c509e-9e5a-4ec1-b970-c9090fd76ae4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.067743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a6279b0f-89fd-4e4b-95bd-1778fb17daa9 req-061c509e-9e5a-4ec1-b970-c9090fd76ae4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:38.101165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-a6279b0f-89fd-4e4b-95bd-1778fb17daa9 req-061c509e-9e5a-4ec1-b970-c9090fd76ae4 service nova] Creating event network-vif-plugged:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:15:38.107707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-a6279b0f-89fd-4e4b-95bd-1778fb17daa9 req-061c509e-9e5a-4ec1-b970-c9090fd76ae4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057736 Jul 14 10:15:38.109253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 111/213] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:38.384542 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:38.385753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:38.393541 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.401163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:38.402755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.403845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:38.662898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:38.671520 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-572b8349-169a-4ceb-8d57-be4729661ca0 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.291723 Jul 14 10:15:38.672306 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 103/214] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:38 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:38.854426 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:38.855120 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:38.867487 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.877058 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:38.877813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:38.885299 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.885453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:38.885746 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:38.886410 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.886528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:38.886873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:38.886994 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:39.200635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:39.208341 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:39.215871 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-408b7b1c-d2f9-4d39-ad86-fd8aba79709e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.342154 Jul 14 10:15:39.215987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7a7220c3-2c84-4081-a4fd-891307a46019 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.366385 Jul 14 10:15:39.216482 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 112/215] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:38 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:39.217462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 104/216] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:38 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:39.226107 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-c4526bc4-1bf8-4e86-b76e-191ea7cac0f5 req-4f0d9342-0312-4252-a656-efe73a1f0ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d591af9c-326b-4bad-8cd9-8384f3cfd68a", "tag": "0b92b721-8d2a-451a-a2e0-ec502f2ca588"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:39.235189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-c4526bc4-1bf8-4e86-b76e-191ea7cac0f5 req-4f0d9342-0312-4252-a656-efe73a1f0ac5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:39.235631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-c4526bc4-1bf8-4e86-b76e-191ea7cac0f5 req-4f0d9342-0312-4252-a656-efe73a1f0ac5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:39.254725 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-c4526bc4-1bf8-4e86-b76e-191ea7cac0f5 req-4f0d9342-0312-4252-a656-efe73a1f0ac5 service nova] Creating event network-changed:0b92b721-8d2a-451a-a2e0-ec502f2ca588 for instance d591af9c-326b-4bad-8cd9-8384f3cfd68a on hv-cinder-84980 Jul 14 10:15:39.259961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-c4526bc4-1bf8-4e86-b76e-191ea7cac0f5 req-4f0d9342-0312-4252-a656-efe73a1f0ac5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037828 Jul 14 10:15:39.260546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 113/217] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:39.689480 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:39.690096 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:39.697214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:39.697869 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:39.698821 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:39.699438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:39.981073 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:39.989922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8fdd71d2-53e8-463b-823f-2be64c835455 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.304324 Jul 14 10:15:39.990549 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 105/218] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:39 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:40.242131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:40.243009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:40.244046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:40.244731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:40.250238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:40.250995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:40.252063 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:40.252579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:40.253870 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:40.254209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:40.254977 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:40.255414 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:40.451952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:40.464134 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9a0c5f77-dcb6-4355-bc36-a74ba60163af tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1258 microversion: 2.1 time: 0.226149 Jul 14 10:15:40.473056 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 114/219] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:40 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1258 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:40.473288 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:40.476057 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d48cb370-b2c6-40f4-9c31-fcc07c831c4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.238041 Jul 14 10:15:40.476801 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 106/220] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:40 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:41.007817 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:41.008520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:41.017441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.018206 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.019183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.019814 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.232377 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:41.243778 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e1f3d55f-6b9b-4053-aba6-c7ba510fb60e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.240526 Jul 14 10:15:41.244738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 115/221] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:41 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:41.480907 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:41.481544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:41.492852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:41.493610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:41.502903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.502903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.502903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.502903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.506808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.507212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.507984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.508423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.915948 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:41.919426 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:41.924253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3cd585d9-2062-4036-a41b-c98733d989b2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.434995 Jul 14 10:15:41.924949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 116/222] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:41 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:41.927362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3a14f96a-aa4b-4e2d-b436-4518435fabb5 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1441 microversion: 2.1 time: 0.450204 Jul 14 10:15:41.928585 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 107/223] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:41 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1441 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:41.944654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:41.945294 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:41.951289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.951747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:41.952579 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:41.952953 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:42.093425 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:42.101151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ea756b11-7420-419e-a0db-6621205369f9 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1441 microversion: 2.1 time: 0.160701 Jul 14 10:15:42.101720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 117/224] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:41 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1441 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:42.261252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:42.261940 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:42.270675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:42.271144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:42.271972 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:42.272444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:42.414498 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:42.422315 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-893c9587-6438-42f0-8804-5258b7a6ca20 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.164979 Jul 14 10:15:42.422907 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 108/225] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:42 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:42.942348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:42.943104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:42.949421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:42.949946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:42.950796 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:42.951437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:43.085674 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:43.093689 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-bef80395-47ff-4651-87d5-b845c4ad7dd4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.155427 Jul 14 10:15:43.094268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 118/226] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:42 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:43.440172 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:43.441432 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:43.449899 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:43.450353 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:43.451140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:43.451577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:43.470406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=100 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:43.588740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:43.596372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5bf97295-47b9-46e8-ab33-00cd313aaa7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.160320 Jul 14 10:15:43.597183 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 109/227] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:43 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:44.082390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-1ce96bb8-c0d6-46f1-b4e0-dd2c2c963f5c req-a0e1148d-e0cb-4692-8fa6-c7628eef69d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:44.090934 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-1ce96bb8-c0d6-46f1-b4e0-dd2c2c963f5c req-a0e1148d-e0cb-4692-8fa6-c7628eef69d2 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:44.091615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-1ce96bb8-c0d6-46f1-b4e0-dd2c2c963f5c req-a0e1148d-e0cb-4692-8fa6-c7628eef69d2 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:44.106534 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-1ce96bb8-c0d6-46f1-b4e0-dd2c2c963f5c req-a0e1148d-e0cb-4692-8fa6-c7628eef69d2 service nova] Creating event network-changed:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:15:44.113370 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-1ce96bb8-c0d6-46f1-b4e0-dd2c2c963f5c req-a0e1148d-e0cb-4692-8fa6-c7628eef69d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Jul 14 10:15:44.114510 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 119/228] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:44.114636 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:44.116101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:44.127140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:44.127596 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:44.128361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:44.129581 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:44.489425 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:44.498418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1b1bbe5a-811e-462d-8400-03cd4b69c534 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.390672 Jul 14 10:15:44.499226 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 110/229] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:44 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:44.614234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:44.617088 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:44.624727 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:44.625337 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:44.626184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:44.626678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:44.799343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:44.808779 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-bee3ef07-8380-4eb6-b21e-18f5c2e8b5ab tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.199132 Jul 14 10:15:44.809509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 120/230] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:44 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:45.516750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:45.517478 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:45.524184 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:45.524708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:45.525576 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:45.526079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:45.668002 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:45.678659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-089e10d4-79ac-48dc-88df-4ca6c8abd6d9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.165658 Jul 14 10:15:45.679896 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 111/231] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:45 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:45.825794 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:45.826416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:45.832538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:45.833011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:45.834437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:45.834880 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:45.855659 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:45.979055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:45.986894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-46ad4baf-ded8-44e4-ae4f-01bd19ee86ec tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.164608 Jul 14 10:15:45.987561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 121/232] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:45 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:46.150647 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-f0609731-7ba9-4ad1-ba01-7c6eb4abffa8 req-4c9aae75-d4fc-4db1-94e9-a2079294fa1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d591af9c-326b-4bad-8cd9-8384f3cfd68a", "name": "network-vif-plugged", "status": "completed", "tag": "0b92b721-8d2a-451a-a2e0-ec502f2ca588"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:46.155327 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:46.155910 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=6 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:46.165102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f0609731-7ba9-4ad1-ba01-7c6eb4abffa8 req-4c9aae75-d4fc-4db1-94e9-a2079294fa1a service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:46.165562 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f0609731-7ba9-4ad1-ba01-7c6eb4abffa8 req-4c9aae75-d4fc-4db1-94e9-a2079294fa1a service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:46.176853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-f0609731-7ba9-4ad1-ba01-7c6eb4abffa8 req-4c9aae75-d4fc-4db1-94e9-a2079294fa1a service nova] Creating event network-vif-plugged:0b92b721-8d2a-451a-a2e0-ec502f2ca588 for instance d591af9c-326b-4bad-8cd9-8384f3cfd68a on hv-cinder-84980 Jul 14 10:15:46.182659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-f0609731-7ba9-4ad1-ba01-7c6eb4abffa8 req-4c9aae75-d4fc-4db1-94e9-a2079294fa1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036433 Jul 14 10:15:46.183679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 112/233] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:46.695792 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:46.696394 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:46.698283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:46.703824 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:46.704270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:46.705065 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:46.705502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:46.836328 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:46.844243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c8d56496-bb93-4c88-bb5f-44cba0a18c5c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.152981 Jul 14 10:15:46.844814 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 122/234] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:46 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:47.003863 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:47.004567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:47.011487 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:47.011942 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:47.012721 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:47.013188 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:47.165855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:47.173214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-484b403b-5f94-468e-9109-bcd8acd7e248 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1314 microversion: 2.1 time: 0.173447 Jul 14 10:15:47.173781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 113/235] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:46 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:47.861600 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:47.862112 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:47.868896 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:47.869376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:47.870140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:47.870583 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:48.006938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:48.014447 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f7edcf1a-e9dd-4bd6-9108-21111edbd843 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.156856 Jul 14 10:15:48.015016 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 123/236] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:47 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:48.190952 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:48.191569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:48.198541 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:48.198996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:48.199769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:48.200202 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:48.357465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:48.364805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-85afa1cf-2b78-407c-ba0e-d3b0712a2a7e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1498 microversion: 2.1 time: 0.177820 Jul 14 10:15:48.365407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 114/237] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:48 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1498 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:49.031909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:49.032568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:49.038799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.039279 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.040149 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.040765 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.040884 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:49.041406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:49.047573 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.048043 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.049020 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.049462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.074840 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:15:49.154980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-82e6c2a4-93e3-4374-b1fc-59abb390f303 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 204 len: 0 microversion: 2.1 time: 0.117712 Jul 14 10:15:49.155752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 115/238] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:15:49 2022] DELETE /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 10:15:49.165054 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:49.166005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:49.174434 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.174981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.175875 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.176440 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.186436 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:49.194718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-93ee9e0a-8286-4338-849e-fcccd5e9ba8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.166167 Jul 14 10:15:49.195412 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 124/239] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:49 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:49.310634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:49.318960 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d4d4e8ed-1d9d-485e-9ff0-d0058d0a463f tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1504 microversion: 2.1 time: 0.158729 Jul 14 10:15:49.320048 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 116/240] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:49 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:49.634961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:49.635385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:49.642016 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.642472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.643312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:49.643866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:49.669584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-71caba08-03f9-4e8d-89d4-ed7e605b3293 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/ips" status: 200 len: 149 microversion: 2.1 time: 0.039147 Jul 14 10:15:49.670157 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 125/241] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:15:49 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:50.212548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:50.213366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:50.220128 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:50.220574 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:50.221372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:50.221806 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:50.337120 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:50.337726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:50.343654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:50.344100 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:50.344856 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:50.345320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:50.350665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:50.359302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7fdd0660-cbfc-4a42-bc00-809e4e17f4d2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.151394 Jul 14 10:15:50.359879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 117/242] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:50 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:50.483152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:50.491982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5ee11549-891e-4e21-a7a3-c235a0f9d4fc tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1504 microversion: 2.1 time: 0.159334 Jul 14 10:15:50.492999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 126/243] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:50 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:51.022588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9b71032-9cf9-4711-af61-6b41c20ed02f"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:51.023708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:51.029873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:51.030324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:51.031079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:51.031512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:51.361304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-66f4b98c-c884-4eb4-b47f-1d0405986754 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342405 Jul 14 10:15:51.362194 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 118/244] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:15:51 2022] POST /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:51.375525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:51.376180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:51.383160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:51.383980 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:51.385852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:51.386522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:51.513204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:51.513911 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:51.520811 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:51.521324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:51.522100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:51.522562 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:51.539672 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:51.548120 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e77cf6cf-2942-4938-8fa5-028f7f1bbc21 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.176591 Jul 14 10:15:51.548716 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 127/245] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:51 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:51.672763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:51.680918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-43eb30cc-982f-4e73-9d2b-54189752608e tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1504 microversion: 2.1 time: 0.174298 Jul 14 10:15:51.681837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 119/246] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:51 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:52.342951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-52d80272-43a2-43ba-8904-7f2b11f113f3 req-fa82e868-f7f6-4007-8959-78a036c62aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d591af9c-326b-4bad-8cd9-8384f3cfd68a", "name": "network-vif-deleted", "tag": "0b92b721-8d2a-451a-a2e0-ec502f2ca588"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:15:52.352290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-52d80272-43a2-43ba-8904-7f2b11f113f3 req-fa82e868-f7f6-4007-8959-78a036c62aba service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:52.352733 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-52d80272-43a2-43ba-8904-7f2b11f113f3 req-fa82e868-f7f6-4007-8959-78a036c62aba service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:52.368009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-52d80272-43a2-43ba-8904-7f2b11f113f3 req-fa82e868-f7f6-4007-8959-78a036c62aba service nova] Creating event network-vif-deleted:0b92b721-8d2a-451a-a2e0-ec502f2ca588 for instance d591af9c-326b-4bad-8cd9-8384f3cfd68a on hv-cinder-84980 Jul 14 10:15:52.373384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-52d80272-43a2-43ba-8904-7f2b11f113f3 req-fa82e868-f7f6-4007-8959-78a036c62aba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Jul 14 10:15:52.374146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 128/247] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:52.566144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:52.566876 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:52.573977 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:52.574302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:52.575086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:52.575542 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:52.699052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:52.699743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:52.706436 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:52.706881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:52.707669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:52.708096 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:52.719315 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:52.727880 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6433ef45-0dda-4587-84e0-4a9f0d1c73c7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.165796 Jul 14 10:15:52.728461 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 120/248] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:52 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:15:52.737055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:52.741036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:52.742094 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:52.742464 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lazy-loading 'fault' on Instance uuid d591af9c-326b-4bad-8cd9-8384f3cfd68a {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:15:52.789160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5298be027cf843638957c4a15003db7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f523b9be668a4dc69619027cec280a08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:52.796642 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-54c5e18f-12bc-43d6-85a8-879adcf75182 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 200 len: 1304 microversion: 2.1 time: 0.102315 Jul 14 10:15:52.797422 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 129/249] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:52 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:53.745011 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:53.745616 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:53.752210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:53.752791 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:53.753603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:53.754043 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:53.813873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:53.814485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] [instance: d591af9c-326b-4bad-8cd9-8384f3cfd68a] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:53.822552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:53.823593 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:53.824390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:53.824831 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:53.844851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] HTTP exception thrown: Instance d591af9c-326b-4bad-8cd9-8384f3cfd68a could not be found. Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Request method failure captured: Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a HTTP/1.1 Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-ywUOLCa6Vc0LlUszSqi9NoKCLlHq5yAedcZ1Azpi5K5m3CGnIjgUzGKH1Opy0gpIaSB9MVnQuf5ILCioFVfhMRGB0qrY_J4IBf1Y7oF6Ah32nWBO60sHZhNqtcM4IhLC088El41EBHFToIVEAH1DHljOvwAFJU1Faj53aQqC38OlY Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: f523b9be668a4dc69619027cec280a08 Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesActionsTest-1384045112 Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:15:53.846529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f523b9be668a4dc69619027cec280a08", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f523b9be668a4dc69619027cec280a08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f523b9be668a4dc69619027cec280a08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f523b9be668a4dc69619027cec280a08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesActionsTest-1384045112 Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: f523b9be668a4dc69619027cec280a08 Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesActionsTest-1384045112 Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesActionsTest-1384045112-project Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 5298be027cf843638957c4a15003db7f Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesActionsTest-1384045112-project Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance d591af9c-326b-4bad-8cd9-8384f3cfd68a could not be found. Jul 14 10:15:53.847750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'd591af9c-326b-4bad-8cd9-8384f3cfd68a'} Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d591af9c-326b-4bad-8cd9-8384f3cfd68a could not be found. Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:15:53.848455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d591af9c-326b-4bad-8cd9-8384f3cfd68a could not be found. Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d591af9c-326b-4bad-8cd9-8384f3cfd68a could not be found. Jul 14 10:15:53.850087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:15:53.851135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] Returning 404 to user: Instance d591af9c-326b-4bad-8cd9-8384f3cfd68a could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:15:53.851135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7229e5b8-6a53-4642-a5ce-ff3a025c1aa2 tempest-VolumesActionsTest-1384045112 tempest-VolumesActionsTest-1384045112-project] 10.222.0.61 "GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a" status: 404 len: 111 microversion: 2.1 time: 0.038397 Jul 14 10:15:53.851135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 130/250] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:53 2022] GET /compute/v2.1/servers/d591af9c-326b-4bad-8cd9-8384f3cfd68a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:15:53.906208 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:53.915867 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c5d191de-951e-4a86-9e92-8f3375f72bca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.174382 Jul 14 10:15:53.917317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 121/251] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:53 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:54.933533 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:54.934187 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:54.940097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:54.940543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:54.941561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:54.942096 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:55.090959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:55.098619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b51aa7ac-4ab6-4c9e-a89f-793b7aa07896 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.169230 Jul 14 10:15:55.099176 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 131/252] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:54 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:56.115404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:56.116028 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:56.123126 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:56.123573 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:56.124332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:56.124767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:56.257729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:56.265181 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-642adf3e-72da-4195-8537-0d6a6017ef02 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.153569 Jul 14 10:15:56.265750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 122/253] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:56 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:56.630466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:56.631002 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:56.637081 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:56.637532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:56.638291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:56.638728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:56.661212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c0df6c8d-5862-4667-95bb-01ae396a6ac4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/ips" status: 200 len: 146 microversion: 2.1 time: 0.034588 Jul 14 10:15:56.661760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 132/254] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:15:56 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:15:57.282196 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:57.282810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:57.289514 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:57.289899 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:57.290667 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:57.291107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:57.417735 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:57.421242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:57.426180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-46c69949-6191-4207-8011-3d409baf9477 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.147839 Jul 14 10:15:57.426750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 123/255] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:57 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:58.443349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:58.443973 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:58.450690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:58.451144 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:58.451914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:58.452360 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:58.582320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:58.590415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7937c4fd-824d-41ce-873e-ac5faba8e30c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.150931 Jul 14 10:15:58.590977 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 133/256] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:58 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:15:59.606906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:15:59.607519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:15:59.610359 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:15:59.627292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:59.627790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:59.628620 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:15:59.629167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:15:59.791026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:15:59.799809 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d33b5707-2e72-4703-ab9e-b533baa26205 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.196429 Jul 14 10:15:59.800944 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 124/257] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:15:59 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:00.821358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:00.822513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:00.829636 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:00.830453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:00.831411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:00.832012 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:00.994250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:01.004724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-deda3426-2999-4f66-af41-03b27604b593 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1502 microversion: 2.1 time: 0.190988 Jul 14 10:16:01.006341 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 134/258] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:00 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:01.022763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "488f45db-1458-4e61-8e22-1d3bdb281b45"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:01.023992 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:01.039981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.041473 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.045268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.045987 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.049677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48357fbc-7064-42cc-a0aa-c438382cded1"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:01.051057 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:01.058502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.059199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.060208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.060852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.080709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] HTTP exception thrown: Cannot 'attach_volume' instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 while it is in vm_state rescued Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Request method failure captured: Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/os-volume_attachments HTTP/1.1 Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 74 Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmF_Dc5KK5U5RdOgCMFwTKCWRHcGY1SqAkKmXT9zqBHXLhW5Hy9gSLv7K34Pgdyv9-5xDIuGCEvIc-LU5hPPiY-CYtXCZHwT22mfzAVgT0-Lo9gKnjdYpdAPVBB2qeBWa_3tXTpi-vRR3BDRDONwkjsji7kPVoDokgsHaGocluCAk Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:16:01.084175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_76e4caaf5b9e49678bc6427b71560f19", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: ca339e26746a4feaaa25b14be59479a4 Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {"volumeAttachment": {"volumeId": "488f45db-1458-4e61-8e22-1d3bdb281b45"}} Jul 14 10:16:01.085788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Cannot 'attach_volume' instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 while it is in vm_state rescued Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'server_id': '0afff4cc-eaa2-4da3-8511-45d0b306c539', 'body': {'volumeAttachment': {'volumeId': '488f45db-1458-4e61-8e22-1d3bdb281b45'}}} Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:16:01.086781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 while it is in vm_state rescued Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:16:01.087962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:16:01.089150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:16:01.089150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:16:01.089150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 while it is in vm_state rescued Jul 14 10:16:01.089150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:16:01.090384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Returning 409 to user: Cannot 'attach_volume' instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 while it is in vm_state rescued {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:16:01.091261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-de93572f-94b0-4254-a058-5ca3ec85f14a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072946 Jul 14 10:16:01.095247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 125/259] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:16:01 2022] POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 10:16:01.101663 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:01.102230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:01.109124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.109703 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.110632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.111076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.193069 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f1f94377-c688-48f0-9b82-547cd8f8ca24 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/action" status: 202 len: 0 microversion: 2.1 time: 0.096350 Jul 14 10:16:01.193810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 126/260] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:16:01 2022] POST /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:16:01.203068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:01.203959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:01.211611 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.212080 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.212867 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:01.213373 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:01.383038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:01.390747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0088ecfa-32fe-45f3-90db-ac310ee09319 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1510 microversion: 2.1 time: 0.192436 Jul 14 10:16:01.391377 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 127/261] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:01 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:02.109375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-80e24398-23b0-4f24-95f8-27247b219b98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.063321 Jul 14 10:16:02.111381 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 135/262] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:16:01 2022] POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-volume_attachments => generated 194 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:02.336029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dd5415e9-549b-4b0e-b71d-dbc8eb1c4518 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: .version_select at 0x7f562815a0d0>, body: {"keypair": {"name": "tempest-keypair-1196615512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMC+e5L1lWN0s2GsMVSwBuS71sdoTxphsd9EqZ2w0oSX6ns95TctCekTU9Z/Ep0QoucoezKi1jFYhtmVdPLfbp/RJ3mWuw8kV7k41UDd4vruWcSo+E0I+jq55RRc3GntMA=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:02.362393 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-dd5415e9-549b-4b0e-b71d-dbc8eb1c4518 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:16:02.368805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-dd5415e9-549b-4b0e-b71d-dbc8eb1c4518 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:16:02.410860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:02.411564 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:02.424897 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:02.425972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:02.426382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:02.427628 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:02.439112 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dd5415e9-549b-4b0e-b71d-dbc8eb1c4518 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108271 Jul 14 10:16:02.445184 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 128/263] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:16:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:02.644235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:02.654040 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-868689db-56bf-4bc0-8393-9670ec7234a9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1510 microversion: 2.1 time: 0.247739 Jul 14 10:16:02.659433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 136/264] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:02 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:03.677185 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:03.679222 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:03.696471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:03.697223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:03.698779 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:03.699418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:03.914842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:03.925494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fb066f27-4424-4e4a-a8ff-592e2a04ec49 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1510 microversion: 2.1 time: 0.253033 Jul 14 10:16:03.926567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 129/265] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:03 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:04.195976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-306577786", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f"}], "security_groups": [{"name": "tempest-securitygroup--1968111343"}], "key_name": "tempest-keypair-1196615512", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:04.315897 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] validate_networks() for [('2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:16:04.770336 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:16:04.770979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:16:04.771612 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:16:04.772117 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:16:04.772696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:16:04.783547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:04.784353 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:04.785456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:04.786135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:04.807513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:16:04.811914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:16:04.823838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:16:04.826245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:16:04.883061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-90982b4b-a68f-4f1f-934c-f50ef4c66c5a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691675 Jul 14 10:16:04.884171 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 137/266] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:16:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:16:04.900135 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-843ecab5-e397-4fdb-ab27-300765cec034 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:04.901334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-843ecab5-e397-4fdb-ab27-300765cec034 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:04.946208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:04.947440 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:04.960072 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:04.961677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:04.963428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:04.964343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:05.018426 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-843ecab5-e397-4fdb-ab27-300765cec034 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:05.028122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-843ecab5-e397-4fdb-ab27-300765cec034 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1241 microversion: 2.1 time: 0.137036 Jul 14 10:16:05.037457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 130/267] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:04 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:05.145627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:05.150495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:05.156577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ce56055a-06f9-4bcb-8a0a-81ac1dbabe3d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1510 microversion: 2.1 time: 0.216566 Jul 14 10:16:05.157493 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 138/268] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:04 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:06.046056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:06.046994 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:06.057100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:06.057988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:06.059082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:06.059845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:06.145988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:06.154805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c2f6e3b5-4b69-4d81-b239-94358a755ced tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1293 microversion: 2.1 time: 0.113185 Jul 14 10:16:06.156055 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 131/269] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:06 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:06.174886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:06.176243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:06.184711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:06.185467 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:06.186623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:06.187236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:06.345896 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:06.354641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-484c74a7-d598-4c3e-b27c-fb654b6df498 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1516 microversion: 2.1 time: 0.183435 Jul 14 10:16:06.355466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 139/270] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:06 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:07.174204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:07.175487 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:07.191235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:07.192602 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:07.193780 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:07.194920 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:07.318350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:07.339207 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-eb161849-6da6-458d-ad19-165b8a75e157 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1311 microversion: 2.1 time: 0.161602 Jul 14 10:16:07.348677 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 132/271] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:07 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1311 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:08.053505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d600d4b5-c4ac-49b7-9baf-4b95e6c3fbfa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'create', calling method: .version_select at 0x7f56262908b0>, body: {"keypair": {"name": "tempest-keypair-1863858242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkDAbV5QlFS8eRlTs3hFZj3q+jTgTNGkWstYQsiA+lhDWr5142ClGJNQIajZcTRlFa7zgeYkIWoYDml4OpOb3cJkBlnWs/U8QJN+On5mLF73edyApCXDfZH23nxI+hoKw=="}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:08.080456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-d600d4b5-c4ac-49b7-9baf-4b95e6c3fbfa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:16:08.089586 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-d600d4b5-c4ac-49b7-9baf-4b95e6c3fbfa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for user ca339e26746a4feaaa25b14be59479a4 and project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:16:08.215804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d600d4b5-c4ac-49b7-9baf-4b95e6c3fbfa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165400 Jul 14 10:16:08.223837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 140/272] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:16:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:08.357050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:08.357832 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:08.376628 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:08.380403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:08.381362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:08.385186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:08.728748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:08.736559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-98107c9c-5d94-4714-bf51-8f19e2f455ea tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.383808 Jul 14 10:16:08.737482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 133/273] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:08 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:09.756190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:09.759785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:09.794479 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:09.795380 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:09.796514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:09.797212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:09.990020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:10.003280 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1046f121-3f12-4467-bdac-f0bf2fca3dc2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.252005 Jul 14 10:16:10.003601 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 141/274] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:09 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:10.809486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-e82d41b0-b37a-4c65-b86b-0d7035b5dc94 req-9bac1203-d76f-4af8-bbd4-7b304208ce65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48291869-495a-4466-a05f-86a03663c24e", "tag": "f62e512c-782f-43f9-802d-0be372fe0a8b"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:10.825921 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-e82d41b0-b37a-4c65-b86b-0d7035b5dc94 req-9bac1203-d76f-4af8-bbd4-7b304208ce65 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:10.840511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-e82d41b0-b37a-4c65-b86b-0d7035b5dc94 req-9bac1203-d76f-4af8-bbd4-7b304208ce65 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:10.868030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-e82d41b0-b37a-4c65-b86b-0d7035b5dc94 req-9bac1203-d76f-4af8-bbd4-7b304208ce65 service nova] Creating event network-changed:f62e512c-782f-43f9-802d-0be372fe0a8b for instance 48291869-495a-4466-a05f-86a03663c24e on hv-cinder-84980 Jul 14 10:16:10.877202 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-e82d41b0-b37a-4c65-b86b-0d7035b5dc94 req-9bac1203-d76f-4af8-bbd4-7b304208ce65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071075 Jul 14 10:16:10.877809 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 134/275] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:11.019546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:11.020726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:11.029353 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:11.033691 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:11.035484 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:11.036530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:11.255855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2055429034", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c86764b5-6320-470e-8466-fc72ac9ee1be"}], "security_groups": [{"name": "tempest-securitygroup--1828638985"}], "key_name": "tempest-keypair-1863858242", "user_data": "}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:11.426657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:11.435820 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f756ec11-734e-41cf-b2a3-76274fd40699 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.419956 Jul 14 10:16:11.448319 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 142/276] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:11 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:11.489940 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] validate_networks() for [('c86764b5-6320-470e-8466-fc72ac9ee1be', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:16:12.138744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:16:12.139878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:16:12.140590 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:16:12.141267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:16:12.142031 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:16:12.157336 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:12.158056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:12.158999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:12.159593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:12.194554 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:16:12.205839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Getting quotas for user ca339e26746a4feaaa25b14be59479a4 and project 76e4caaf5b9e49678bc6427b71560f19. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:16:12.253307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:16:12.256109 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:16:12.385584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-13f501ab-ec0e-46f1-a77c-457236a2ae67 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.134297 Jul 14 10:16:12.387450 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 135/277] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:16:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:16:12.405477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-65af626b-2032-43b3-8208-31a9138717a0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:12.406139 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-65af626b-2032-43b3-8208-31a9138717a0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:12.462634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:12.463506 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:12.482638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:12.491439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:12.492585 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:12.493207 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:12.519211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-65af626b-2032-43b3-8208-31a9138717a0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:12.529257 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-65af626b-2032-43b3-8208-31a9138717a0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1246 microversion: 2.1 time: 0.133385 Jul 14 10:16:12.534589 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 143/278] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:12 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1246 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:12.722151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:12.739926 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-084212a7-7a34-4d46-9df3-f76218703c93 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.289334 Jul 14 10:16:12.741767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 136/279] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:12 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:13.502877 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-081c10d1-5f5c-4290-bc5c-548455a0870f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:13.513996 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-081c10d1-5f5c-4290-bc5c-548455a0870f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.517325 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-081c10d1-5f5c-4290-bc5c-548455a0870f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:13.550724 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:13.551365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:13.565341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.565650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:13.566321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.566951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:13.597124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-081c10d1-5f5c-4290-bc5c-548455a0870f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Going to try to stop instance {{(pid=117809) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 10:16:13.660660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:13.666741 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-081c10d1-5f5c-4290-bc5c-548455a0870f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action" status: 202 len: 0 microversion: 2.1 time: 0.167661 Jul 14 10:16:13.670738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-75e32853-d896-4f68-bafb-2a34c9b04c33 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1298 microversion: 2.1 time: 0.123501 Jul 14 10:16:13.670910 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 144/280] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:16:13 2022] POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:16:13.672042 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 137/281] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:13 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:13.697194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:13.697194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:13.700518 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.701031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:13.701819 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.702252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:13.749730 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1882980820", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "networks": [{"uuid": "0e4c91b4-c74a-406f-b9e7-1f32ae5cd0f4"}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:13.811290 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] validate_networks() for [('0e4c91b4-c74a-406f-b9e7-1f32ae5cd0f4', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:16:13.953679 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:13.971265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e3ebfec1-596f-472e-a271-d675be724a65 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.299106 Jul 14 10:16:13.975083 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 145/282] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:13 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:13.986159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:13.987107 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:13.997198 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.998044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:13.999072 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:13.999726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:14.257470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:14.268463 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7c27116a-d099-4158-8db6-3d713bb03047 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.287675 Jul 14 10:16:14.270556 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 146/283] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:13 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:14.407705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:16:14.408199 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:16:14.408800 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:16:14.409237 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:16:14.409646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:16:14.419469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:14.419913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:14.420702 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:14.421156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:14.438659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Getting quotas for project a2eeff0739c1463383b618c4c56ae344. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:16:14.442451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Getting quotas for user 9eebb3ed7b2342efbd3eb4e72329c1e3 and project a2eeff0739c1463383b618c4c56ae344. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:16:14.453614 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:16:14.455734 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:16:14.516601 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a2206820-b734-4360-b063-0d8fd6700cd7 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770757 Jul 14 10:16:14.522604 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 138/284] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:16:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:16:14.532148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3484da9e-d00b-4138-9e51-9ebd2cac0f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:14.532872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3484da9e-d00b-4138-9e51-9ebd2cac0f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:14.635972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3484da9e-d00b-4138-9e51-9ebd2cac0f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:14.642761 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3484da9e-d00b-4138-9e51-9ebd2cac0f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1219 microversion: 2.1 time: 0.119126 Jul 14 10:16:14.643325 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 147/285] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:14 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:14.698046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:14.698835 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:14.711457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:14.712079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:14.713035 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:14.713700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:14.809810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:14.823036 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3e7a3041-584c-4d79-9f45-94d4ecef3b03 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1306 microversion: 2.1 time: 0.133210 Jul 14 10:16:14.825195 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 139/286] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:14 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1306 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:14.998414 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:14.999097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:15.005426 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:15.015723 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.016197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.017169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.017854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.220601 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:15.230365 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2bbb42b7-ae59-4f8d-8467-2f7a4710477c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.240377 Jul 14 10:16:15.231137 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 148/287] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:14 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:15.286168 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:15.287113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:15.293791 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.294351 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.295241 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.295753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.440030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:15.449086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-278971e5-7e78-40ab-b73a-c02714dc318b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.166780 Jul 14 10:16:15.449680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 140/288] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:15 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:15.659643 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:15.660369 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:15.667337 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.668060 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.668856 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.669386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.735948 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:15.745638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-162d1675-4552-49f4-b668-b831e9a9eec6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1223 microversion: 2.1 time: 0.089838 Jul 14 10:16:15.746475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 149/289] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:15 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:15.843063 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:15.844594 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:15.859500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.860561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.861634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:15.864295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:15.951561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:15.961526 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d0dd3443-e59d-458c-a9ba-a5a5e04d30c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1306 microversion: 2.1 time: 0.124662 Jul 14 10:16:15.962790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 141/290] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:15 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1306 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:16.249830 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:16.250443 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:16.260655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.265316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.266199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.266646 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.466456 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:16.466971 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:16.476696 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.479872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.481012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.484045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.500621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:16.512239 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-30ecad8c-d431-45f1-abf9-2b8e2eb5f613 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.266680 Jul 14 10:16:16.513000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 150/291] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:16 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:16.763221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:16.763874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:16.773798 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.774247 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.779592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.780269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.921590 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:16.931847 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c59a753d-34f5-4986-8cb8-6ec7f6e6270b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.469181 Jul 14 10:16:16.940836 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 142/292] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:16 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:16.956421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:16.965836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d0f19603-4181-40ce-ab8b-e176e80ab2a5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1279 microversion: 2.1 time: 0.206334 Jul 14 10:16:16.981540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 151/293] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:16 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:16.989259 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:16.989259 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:16.996373 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.997023 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:16.997908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:16.998969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:17.369236 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:17.374950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:17.389987 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dacfc114-502c-49de-9c06-2f1ab3e3bbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.410195 Jul 14 10:16:17.399499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 143/294] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:16 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:17.530853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:17.531855 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:17.541029 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:17.543574 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:17.544388 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:17.544835 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:17.875187 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:17.886871 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f8b58b57-9530-424e-ac0c-94d5c4ad93da tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.360390 Jul 14 10:16:17.897282 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 152/295] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:17 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:17.956675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:17.959243 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:17.967940 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-6af1debb-ec0e-4ee2-a328-bd85af889d6b req-103deb3a-d2cb-4398-8977-60c0b60e02f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b52dc3-0452-4872-b526-d4fce9ef4e93", "tag": "b40b14ad-171e-4c6c-a909-36191cb0c933"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:17.973291 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:17.974132 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:17.976159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:17.976878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:17.991378 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6af1debb-ec0e-4ee2-a328-bd85af889d6b req-103deb3a-d2cb-4398-8977-60c0b60e02f6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:17.994095 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6af1debb-ec0e-4ee2-a328-bd85af889d6b req-103deb3a-d2cb-4398-8977-60c0b60e02f6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:18.027116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-6af1debb-ec0e-4ee2-a328-bd85af889d6b req-103deb3a-d2cb-4398-8977-60c0b60e02f6 service nova] Creating event network-changed:b40b14ad-171e-4c6c-a909-36191cb0c933 for instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 on hv-cinder-84980 Jul 14 10:16:18.034302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-6af1debb-ec0e-4ee2-a328-bd85af889d6b req-103deb3a-d2cb-4398-8977-60c0b60e02f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071212 Jul 14 10:16:18.036318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 153/296] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:18.042416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:18.043411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:18.051958 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:18.054077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:18.057470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:18.058096 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:18.246879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:18.256480 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3d1d9eba-48ba-4719-8f09-5c6dd8d68f1d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.311272 Jul 14 10:16:18.257379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 144/297] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:17 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:18.283878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:18.293052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-076d347f-3ecf-457e-8f2d-550ce61c5f7f tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.255305 Jul 14 10:16:18.293822 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 154/298] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:18 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:18.406499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:18.407299 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:18.414700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:18.415155 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:18.415934 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:18.416368 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:18.583330 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:18.594393 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e9daa3de-4329-4597-8e2c-c5ab630c0014 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.191597 Jul 14 10:16:18.595235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 145/299] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:18 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:18.905460 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:18.906251 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:18.914787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:18.915371 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:18.916347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:18.916833 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.081308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:19.096160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6fd31fde-a152-4e26-a652-0b4d55720a98 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.196043 Jul 14 10:16:19.096869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 155/300] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:18 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:19.276899 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:19.277902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:19.286086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:19.286937 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.289125 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:19.289564 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.311231 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:19.312317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:19.325731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:19.326522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.327540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:19.328118 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.528891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:19.547545 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:19.548366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-78d64cf5-4030-490e-9878-9b53a9628429 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.277971 Jul 14 10:16:19.549696 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 146/301] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:19 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:19.561250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b1126f7c-ac01-41c9-aae3-8ca27bfd771c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.254524 Jul 14 10:16:19.562119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 156/302] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:19 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:19.622018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:19.622968 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:19.629475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:19.630187 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.631676 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:19.632180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:19.781755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:19.790671 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8b003124-1c65-4086-830a-e56363bdad0d tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.172443 Jul 14 10:16:19.791577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 147/303] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:19 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:20.113689 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:20.114959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:20.122492 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:20.122942 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:20.123890 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:20.124503 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:20.262801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:20.272514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fd9c2da4-f3a3-487e-a95c-e0fddf0ce1f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.161434 Jul 14 10:16:20.272514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 157/304] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:20 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:20.567076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:20.567679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:20.577571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:20.585718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:20.592341 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:20.593196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:20.594181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:20.594785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:20.599416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:20.599992 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:20.601061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:20.605035 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:20.664745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:20.966983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:20.979249 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1b47e024-af7e-4c66-8a17-fc079576fe1b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.403183 Jul 14 10:16:20.980343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 158/305] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:20 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:21.005424 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:21.006052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:21.018665 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:21.019180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:21.019986 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:21.024517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:21.072087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:21.084338 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-07a535d2-1770-4de7-bad9-b70af23e7bff tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.520737 Jul 14 10:16:21.085443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 148/306] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:20 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:21.288906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:21.289638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:21.297404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:21.298658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:21.300665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:21.301500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:21.333920 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:21.355619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b02b5d96-317b-499f-a3a5-c777e0dd4743 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.359895 Jul 14 10:16:21.366971 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 159/307] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:20 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:21.537778 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:21.568187 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-51860b8e-c4d8-403c-b61e-44eb1469b13e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.283456 Jul 14 10:16:21.571078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 149/308] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:21 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:21.832841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-34103389-accd-425b-81bc-cbbdc055ceda req-f31fcc84-6afc-4055-8b07-2235fd34786e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5164f3a1-116c-47db-8d85-1e34b56e4018", "tag": "4fe03bab-cecb-4477-ab70-6692900e70c5"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:21.851717 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-34103389-accd-425b-81bc-cbbdc055ceda req-f31fcc84-6afc-4055-8b07-2235fd34786e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:21.852353 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-34103389-accd-425b-81bc-cbbdc055ceda req-f31fcc84-6afc-4055-8b07-2235fd34786e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:21.865261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-34103389-accd-425b-81bc-cbbdc055ceda req-f31fcc84-6afc-4055-8b07-2235fd34786e service nova] Creating event network-changed:4fe03bab-cecb-4477-ab70-6692900e70c5 for instance 5164f3a1-116c-47db-8d85-1e34b56e4018 on hv-cinder-84980 Jul 14 10:16:21.870244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-34103389-accd-425b-81bc-cbbdc055ceda req-f31fcc84-6afc-4055-8b07-2235fd34786e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041105 Jul 14 10:16:21.871417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 160/309] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:21.996502 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:21.997158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:22.003555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.004038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.004799 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.005347 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.102142 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:22.102842 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:22.112065 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.112465 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.114168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.119556 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.234912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:22.248746 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6b6c6703-a927-4087-9c9a-f38778e6bf81 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.256013 Jul 14 10:16:22.249913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 150/310] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:21 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:22.342682 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:22.351360 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1a0b0ddf-e592-4075-9da3-663e85438b4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.253293 Jul 14 10:16:22.352148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 161/311] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:22 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:22.374544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:22.375203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:22.382375 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.382930 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.383627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.384076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.529726 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:22.538479 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7179fbe4-5011-4f2c-b799-046dcf0a3345 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.167793 Jul 14 10:16:22.539701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 151/312] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:22 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:22.588241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:22.589077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:22.595233 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.595688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.596637 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.597122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.758184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:22.768871 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6b8c1b66-1bb5-4f84-b525-2640dffc130c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.184428 Jul 14 10:16:22.769646 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 162/313] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:22 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:22.790595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-32018c23-08fb-40fa-9800-b6b0facb2289 req-fc734d40-6c2f-4ded-bf7f-1af29497a615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48291869-495a-4466-a05f-86a03663c24e", "name": "network-vif-plugged", "status": "completed", "tag": "f62e512c-782f-43f9-802d-0be372fe0a8b"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:22.800788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-32018c23-08fb-40fa-9800-b6b0facb2289 req-fc734d40-6c2f-4ded-bf7f-1af29497a615 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:22.801262 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-32018c23-08fb-40fa-9800-b6b0facb2289 req-fc734d40-6c2f-4ded-bf7f-1af29497a615 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:22.814276 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-32018c23-08fb-40fa-9800-b6b0facb2289 req-fc734d40-6c2f-4ded-bf7f-1af29497a615 service nova] Creating event network-vif-plugged:f62e512c-782f-43f9-802d-0be372fe0a8b for instance 48291869-495a-4466-a05f-86a03663c24e on hv-cinder-84980 Jul 14 10:16:22.819747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-32018c23-08fb-40fa-9800-b6b0facb2289 req-fc734d40-6c2f-4ded-bf7f-1af29497a615 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033739 Jul 14 10:16:22.820886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 152/314] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:16:23.266457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:23.267074 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:23.269783 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:23.275803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.276254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.277315 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.277753 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.370559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:23.371364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:23.378325 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:23.379983 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.380475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.381563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.382168 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.531822 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:23.540133 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9bf26875-c664-475e-9bf0-18728db8ed76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.277686 Jul 14 10:16:23.540709 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 163/315] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:23 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:23.556160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:23.557114 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:23.565296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.565755 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.566538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.566977 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.642207 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:23.651071 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dec4b612-b6f3-4e3f-a50e-9f54526e2d83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.285836 Jul 14 10:16:23.652019 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 153/316] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:23 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:23.745708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:23.753197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-68238dbc-59d1-4f09-90be-1467125e34c6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.200889 Jul 14 10:16:23.753808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 164/317] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:23 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:23.786951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:23.788113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:23.794429 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.795015 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.795690 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:23.796131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:23.935931 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:23.944033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f04d25b7-8f63-4f46-8244-66c2a1e02df7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.161099 Jul 14 10:16:23.944603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 154/318] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:23 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:24.557235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:24.558089 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:24.564975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.565757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.566545 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.566969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.642940 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=14 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:24.669813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:24.670433 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:24.672882 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=4 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:24.673629 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=18 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:24.680546 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.681306 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.682277 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.682905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.707212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:24.715582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d848bdc5-0722-455f-9130-1a86df81cc88 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.163010 Jul 14 10:16:24.716270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 165/319] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:24 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:24.770235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:24.771108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:24.778324 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.778785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.779750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.780393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.876700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:24.884083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-850c732d-6e01-4ca2-a9a6-b4a8dc0fcf4f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1367 microversion: 2.1 time: 0.219223 Jul 14 10:16:24.884846 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 155/320] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:24 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:24.944183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:24.951737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6c88252b-4926-4708-a185-79f7a52995df tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.185476 Jul 14 10:16:24.952308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 166/321] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:24 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:24.961844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:24.962451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:24.968423 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.968864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:24.969658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:24.970221 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:25.163232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:25.171342 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fb82cb68-1a44-4623-92e2-30830987f40a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.214058 Jul 14 10:16:25.171919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 156/322] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:24 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:25.731974 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:25.733194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:25.741354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:25.742401 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:25.743423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:25.744259 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:25.901994 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:25.903237 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:25.914448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:25.915057 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:25.916064 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:25.916620 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.167489 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:26.185409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-13a0f561-eb30-44c0-a1b3-fd573b1e2e94 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.457200 Jul 14 10:16:26.187664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 167/323] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:25 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:26.193242 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:26.194657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:26.202420 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:26.203267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.204076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:26.204503 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.205459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:26.214405 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-463f12a4-014c-4e49-bea7-4d731aa4e213 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1556 microversion: 2.1 time: 0.316803 Jul 14 10:16:26.214985 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 157/324] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:25 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1556 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:26.220371 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:26.221402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:26.227981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:26.228460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.229283 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:26.230009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.417860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:26.427612 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f46a503a-c8d3-4338-9b1a-3323cd7af78e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.238900 Jul 14 10:16:26.428204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 168/325] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:26 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:26.437161 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:26.437161 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:26.438973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:26.439317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:26.439772 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.440721 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:26.441190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:26.447990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dfb1d410-1c00-440b-a38f-881b14da9723 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.231793 Jul 14 10:16:26.448742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 158/326] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:26 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:26.528824 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a000654c-f8a8-4f50-bee9-ccb1b15328a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099550 Jul 14 10:16:26.529585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 169/327] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:16:26 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:27.133701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-f95c5e41-1e85-45ac-955d-bb7f1e06b56a req-b06aebf8-b1d9-4855-870f-ba41d1e7d60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b52dc3-0452-4872-b526-d4fce9ef4e93", "name": "network-vif-plugged", "status": "completed", "tag": "b40b14ad-171e-4c6c-a909-36191cb0c933"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:27.158305 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f95c5e41-1e85-45ac-955d-bb7f1e06b56a req-b06aebf8-b1d9-4855-870f-ba41d1e7d60f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.158763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-f95c5e41-1e85-45ac-955d-bb7f1e06b56a req-b06aebf8-b1d9-4855-870f-ba41d1e7d60f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.185423 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-f95c5e41-1e85-45ac-955d-bb7f1e06b56a req-b06aebf8-b1d9-4855-870f-ba41d1e7d60f service nova] Creating event network-vif-plugged:b40b14ad-171e-4c6c-a909-36191cb0c933 for instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 on hv-cinder-84980 Jul 14 10:16:27.191653 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-f95c5e41-1e85-45ac-955d-bb7f1e06b56a req-b06aebf8-b1d9-4855-870f-ba41d1e7d60f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062465 Jul 14 10:16:27.192584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 159/328] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:27.205803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:27.206724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:27.215048 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.217648 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.218727 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.219814 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.445748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:27.446631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:27.452946 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.453416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.454253 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.454695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.514338 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:27.522916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-505e1d44-7c71-4151-9335-b1d252245b67 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.321532 Jul 14 10:16:27.523874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 170/329] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:27 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:27.538561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:27.539244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:27.545879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.546505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.547833 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:27.548351 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:27.776621 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:27.784990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-92e59682-6355-4e3f-b05d-8e82a7b50796 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.344175 Jul 14 10:16:27.785788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 160/330] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:27 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:27.855008 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:27.878642 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a8824b89-b114-42bb-9961-65c04dec5442 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.332201 Jul 14 10:16:27.889189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 171/331] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:27 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:28.007343 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-564251a1-9833-49e0-9065-28a1cb022523 req-43828b49-ab54-45e0-a4c8-4ac8883e6e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48291869-495a-4466-a05f-86a03663c24e", "tag": "f62e512c-782f-43f9-802d-0be372fe0a8b"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:28.019155 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-564251a1-9833-49e0-9065-28a1cb022523 req-43828b49-ab54-45e0-a4c8-4ac8883e6e13 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.019609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-564251a1-9833-49e0-9065-28a1cb022523 req-43828b49-ab54-45e0-a4c8-4ac8883e6e13 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:28.032521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-564251a1-9833-49e0-9065-28a1cb022523 req-43828b49-ab54-45e0-a4c8-4ac8883e6e13 service nova] Creating event network-changed:f62e512c-782f-43f9-802d-0be372fe0a8b for instance 48291869-495a-4466-a05f-86a03663c24e on hv-cinder-84980 Jul 14 10:16:28.037714 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-564251a1-9833-49e0-9065-28a1cb022523 req-43828b49-ab54-45e0-a4c8-4ac8883e6e13 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035292 Jul 14 10:16:28.039113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 161/332] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:28.540377 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:28.541124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:28.548783 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.549307 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:28.550202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.550652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:28.803968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:28.807753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:28.809030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:28.816458 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.817264 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:28.818281 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.819430 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:28.821250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2bd233a8-3211-4785-9758-6b476ba2aa08 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.283472 Jul 14 10:16:28.831239 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 172/333] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:28 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:28.847794 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=100 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:28.902385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:28.903581 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:28.913210 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.913488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:28.914320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:28.914766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:29.131991 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:29.153883 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ac21058c-2c7c-4c97-899b-a08fd3acbf5a tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1372 microversion: 2.1 time: 0.351073 Jul 14 10:16:29.155538 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 162/334] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:28 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:29.164356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1971711122", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:29.185872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:29.211181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-127705cd-3fad-4a6a-b421-074f78c8facf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.316925 Jul 14 10:16:29.212136 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 173/335] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:28 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:29.248792 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] validate_networks() for None {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:16:29.838539 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:29.839146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:29.839439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:16:29.839982 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:16:29.840563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:16:29.841241 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:16:29.841779 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:16:29.846106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:29.846557 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:29.847529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:29.847970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:29.853640 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:29.854910 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:29.855838 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:29.856405 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:29.875966 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Getting quotas for project 47163a6d0e704f8eb8d0725284918f86. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:16:29.883456 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Getting quotas for user 994f748d68504033a95385b1ab507d85 and project 47163a6d0e704f8eb8d0725284918f86. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:16:29.899110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:16:29.901811 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:16:29.950324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dfff87ad-0bc6-4d8e-8dd3-016ebc59d002 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793509 Jul 14 10:16:29.956056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 163/336] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:16:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:16:29.960964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-55699e9e-c78f-4f2d-b1d3-0e37228930fc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:29.961697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-55699e9e-c78f-4f2d-b1d3-0e37228930fc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:30.010127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:30.018300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-43812a89-8370-443d-a183-0b81c0ed24ef tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.184224 Jul 14 10:16:30.018879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 174/337] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:29 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:30.030064 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-55699e9e-c78f-4f2d-b1d3-0e37228930fc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:30.037922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-55699e9e-c78f-4f2d-b1d3-0e37228930fc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1215 microversion: 2.1 time: 0.080628 Jul 14 10:16:30.038748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 164/338] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:29 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:30.173027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:30.174254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:30.181023 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:30.181698 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:30.182484 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:30.182923 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:30.231385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:30.231967 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:30.243434 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:30.243898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:30.244694 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:30.245167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:30.393413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:30.397703 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:30.404009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-14d3c6f6-c0d6-45f6-86c0-c80845c876c9 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1566 microversion: 2.1 time: 0.235040 Jul 14 10:16:30.404784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 175/339] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:30 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:30.416679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:30.420911 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:30.421524 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:30.433619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-96d9bf71-f108-47b2-9a9a-b22145ba452b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.198862 Jul 14 10:16:30.433737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:30.433737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:30.433737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:30.433737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:30.436242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 165/340] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:30 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:30.515357 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b3a2ae16-c445-417e-9ae2-a0946cd92640 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098249 Jul 14 10:16:30.515952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 176/341] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:16:30 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:16:31.035773 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:31.036524 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:31.044715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.045309 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.046392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.047020 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.055906 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:31.057412 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:31.067942 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.069909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.072088 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.072843 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.185657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:31.194186 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4f8d58a1-6511-4a18-bd7a-b83cf3384282 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1267 microversion: 2.1 time: 0.142980 Jul 14 10:16:31.194906 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 177/342] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:31 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:31.219401 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-dbd81f7c-61fe-4c62-915f-a721a760c12b req-4b4db660-04d7-4f21-963c-3f1f148382e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5164f3a1-116c-47db-8d85-1e34b56e4018", "name": "network-vif-plugged", "status": "completed", "tag": "4fe03bab-cecb-4477-ab70-6692900e70c5"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:31.231072 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-dbd81f7c-61fe-4c62-915f-a721a760c12b req-4b4db660-04d7-4f21-963c-3f1f148382e0 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.231661 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-dbd81f7c-61fe-4c62-915f-a721a760c12b req-4b4db660-04d7-4f21-963c-3f1f148382e0 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.252414 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-dbd81f7c-61fe-4c62-915f-a721a760c12b req-4b4db660-04d7-4f21-963c-3f1f148382e0 service nova] Creating event network-vif-plugged:4fe03bab-cecb-4477-ab70-6692900e70c5 for instance 5164f3a1-116c-47db-8d85-1e34b56e4018 on hv-cinder-84980 Jul 14 10:16:31.259924 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-dbd81f7c-61fe-4c62-915f-a721a760c12b req-4b4db660-04d7-4f21-963c-3f1f148382e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044721 Jul 14 10:16:31.260715 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 178/343] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:16:31.341813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:31.351979 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6448e8c6-1188-4f69-b3f6-cef1a89969c0 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.319987 Jul 14 10:16:31.361427 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 166/344] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:31 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:31.444875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:31.445619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:31.452167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.452302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.453118 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.454024 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.763404 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:31.771271 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3ba46919-f783-4bc9-87fc-398c7d989eae tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.331568 Jul 14 10:16:31.771878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 179/345] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:31 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:31.822981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-b33e9df5-67b7-43f5-8a77-23b46f9565a8 req-6d258230-7d78-4403-abe0-49dec3fd9bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b52dc3-0452-4872-b526-d4fce9ef4e93", "tag": "b40b14ad-171e-4c6c-a909-36191cb0c933"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:31.831331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-b33e9df5-67b7-43f5-8a77-23b46f9565a8 req-6d258230-7d78-4403-abe0-49dec3fd9bb3 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:31.831849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-b33e9df5-67b7-43f5-8a77-23b46f9565a8 req-6d258230-7d78-4403-abe0-49dec3fd9bb3 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:31.846136 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-b33e9df5-67b7-43f5-8a77-23b46f9565a8 req-6d258230-7d78-4403-abe0-49dec3fd9bb3 service nova] Creating event network-changed:b40b14ad-171e-4c6c-a909-36191cb0c933 for instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 on hv-cinder-84980 Jul 14 10:16:31.851783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-b33e9df5-67b7-43f5-8a77-23b46f9565a8 req-6d258230-7d78-4403-abe0-49dec3fd9bb3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032385 Jul 14 10:16:31.852374 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 167/346] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:32.211520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:32.212711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:32.220461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:32.221178 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:32.222165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:32.222766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:32.355562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:32.368740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8f9fb2be-baee-4b83-ae47-1688b07d8ade tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1273 microversion: 2.1 time: 0.161452 Jul 14 10:16:32.369872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 180/347] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:32 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:32.371029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:32.371780 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:32.378560 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:32.379203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:32.380982 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:32.381628 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:32.605394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:32.613588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-94dd2a47-c290-42f9-b208-dab000517d5e tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1319 microversion: 2.1 time: 0.248481 Jul 14 10:16:32.614345 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 168/348] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:32 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:32.789737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:32.790727 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:32.808067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:32.821780 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:32.822607 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:32.823068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:33.118222 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:33.131395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b7238c4c-add7-48ff-b733-f365e1821a0a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.345610 Jul 14 10:16:33.132679 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 181/349] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:32 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:33.387212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:33.388181 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:33.403723 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:33.404690 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:33.405818 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:33.406657 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:33.631510 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:33.632022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:33.639367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:33.639817 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:33.640586 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:33.641046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:33.654859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:33.666260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0e14c2b6-e3ea-4236-9bf7-ef130f19959b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.283320 Jul 14 10:16:33.671627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 169/350] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:33 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:33.785698 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:33.793898 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-220aec19-be3b-499c-bd7f-b3215c939732 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1507 microversion: 2.1 time: 0.166786 Jul 14 10:16:33.794489 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 182/351] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:33 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:33.866939 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-67d74615-9467-4ae9-a1d0-e4f7c52f54cd req-cd7f17a5-228a-4d5d-b1f5-1558099a3fcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4349547-2d12-4277-955a-38e90a338d8d", "tag": "bd8ccecb-2a4e-4685-b380-393cb3e7838f"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:33.875281 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-67d74615-9467-4ae9-a1d0-e4f7c52f54cd req-cd7f17a5-228a-4d5d-b1f5-1558099a3fcf service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:33.875725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-67d74615-9467-4ae9-a1d0-e4f7c52f54cd req-cd7f17a5-228a-4d5d-b1f5-1558099a3fcf service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:33.887514 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-67d74615-9467-4ae9-a1d0-e4f7c52f54cd req-cd7f17a5-228a-4d5d-b1f5-1558099a3fcf service nova] Creating event network-changed:bd8ccecb-2a4e-4685-b380-393cb3e7838f for instance c4349547-2d12-4277-955a-38e90a338d8d on hv-cinder-84980 Jul 14 10:16:33.892275 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-67d74615-9467-4ae9-a1d0-e4f7c52f54cd req-cd7f17a5-228a-4d5d-b1f5-1558099a3fcf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029554 Jul 14 10:16:33.892858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 170/352] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:16:34.148079 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:34.148818 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:34.177123 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:34.177643 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:34.178950 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:34.179390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:34.338372 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:34.347565 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-cce4ff17-b8fa-4624-8a78-0bb78da7cfa7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.203485 Jul 14 10:16:34.348428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 183/353] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:34 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:34.687842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:34.688537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:34.696322 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:34.696758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:34.697716 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:34.698314 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:34.837881 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:34.845381 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a931dca7-892a-44e0-9f77-64a023025f9e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.161629 Jul 14 10:16:34.846141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 171/354] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:34 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:35.367228 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:35.367837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:35.374503 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:35.374956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:35.375716 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:35.376155 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:35.501979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:35.510891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-93ff0582-0525-4554-af7e-9358b50914fa tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.148305 Jul 14 10:16:35.511470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 184/355] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:35 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:35.862834 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:35.863438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:35.870377 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:35.870829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:35.871804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:35.872294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:36.013945 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:36.021997 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5395a4f1-fed5-4eb6-a66b-70c97e1d86b0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.162479 Jul 14 10:16:36.022511 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 172/356] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:35 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:36.527988 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:36.528600 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:36.535355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:36.535751 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:36.536517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:36.537487 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:36.666005 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:36.673959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5a83006b-434d-4e22-aa77-4d0af5ce15cf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.150131 Jul 14 10:16:36.674525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 185/357] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:36 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:37.038943 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:37.039559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:37.046129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:37.046580 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:37.047344 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:37.047782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:37.176286 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:37.183700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-76185044-5482-46c4-be73-0608661d4d67 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.148575 Jul 14 10:16:37.184274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 173/358] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:37 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:37.691150 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:37.691799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:37.698979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:37.699482 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:37.700236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:37.700678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:37.833438 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:37.841416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c5214efd-42f7-460f-9b42-079b62494784 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.154174 Jul 14 10:16:37.841982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 186/359] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:37 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:38.200691 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:38.201243 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:38.207711 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:38.208158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:38.208913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:38.209369 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:38.341598 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:38.348986 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-124b05d0-0d00-4687-8c60-421899626988 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.152318 Jul 14 10:16:38.349553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 174/360] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:38 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:38.858333 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:38.858936 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:38.866317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:38.866957 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:38.867724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:38.868164 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:38.995883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:39.004278 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-bb7fa26e-0e38-4616-9032-02f7f3d08706 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.149764 Jul 14 10:16:39.004854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 187/361] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:38 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:39.367877 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:39.368425 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:39.375021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:39.375472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:39.376244 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:39.376685 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:39.517006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:39.524508 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8ecae0e6-e475-4b85-8515-81e08149ca6c tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.161314 Jul 14 10:16:39.525110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 175/362] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:39 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:40.022105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:40.023702 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:40.031896 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:40.032445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:40.033348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:40.033866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:40.181689 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:40.189613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e7fc905e-3eff-4a88-9605-cedec48fe387 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1724 microversion: 2.1 time: 0.171704 Jul 14 10:16:40.190178 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 188/363] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:40 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:40.542031 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:40.542676 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:40.544669 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:40.545367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=8 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:40.551885 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:40.552341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:40.553158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:40.554184 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:40.684737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:40.692577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c63c901c-8dce-4976-9f15-2b3a0c8caf5e tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.155703 Jul 14 10:16:40.693205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 176/364] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:40 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:41.207547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:41.208233 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:41.216796 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.217288 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.218065 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.218514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.365506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:41.373831 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2cbf5b67-11d5-49db-a6ae-9260409186bb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1701 microversion: 2.1 time: 0.170274 Jul 14 10:16:41.374398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 189/365] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:41 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:41.390108 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cbe84887-e3fc-4ee9-bcd8-6e4b43839e15 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:41.396376 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cbe84887-e3fc-4ee9-bcd8-6e4b43839e15 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.396936 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cbe84887-e3fc-4ee9-bcd8-6e4b43839e15 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.460975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cbe84887-e3fc-4ee9-bcd8-6e4b43839e15 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Going to try to start instance {{(pid=117810) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 10:16:41.505135 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cbe84887-e3fc-4ee9-bcd8-6e4b43839e15 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action" status: 202 len: 0 microversion: 2.1 time: 0.118610 Jul 14 10:16:41.506095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 177/366] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:16:41 2022] POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:16:41.514350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:41.514959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:41.521418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.521874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.523326 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.523629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.684821 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:41.695045 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-97fe0136-967c-4811-b7d2-ddba3956200a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1710 microversion: 2.1 time: 0.183887 Jul 14 10:16:41.695620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 190/367] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:41 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:41.711013 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:41.711719 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:41.717922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.718379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.719150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:41.719593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:41.848739 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:41.856285 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7857afd8-ebe7-418d-9dd0-87e28ae6e9e7 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.150557 Jul 14 10:16:41.856796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 178/368] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:41 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:42.395413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-88618b0a-d6da-4fb0-adbb-5ced4ae7bb22 req-f622a20b-c8ed-4641-8017-8b0249da12b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4349547-2d12-4277-955a-38e90a338d8d", "name": "network-vif-plugged", "status": "completed", "tag": "bd8ccecb-2a4e-4685-b380-393cb3e7838f"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:42.404754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-88618b0a-d6da-4fb0-adbb-5ced4ae7bb22 req-f622a20b-c8ed-4641-8017-8b0249da12b4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:42.405252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-88618b0a-d6da-4fb0-adbb-5ced4ae7bb22 req-f622a20b-c8ed-4641-8017-8b0249da12b4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:42.418080 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-88618b0a-d6da-4fb0-adbb-5ced4ae7bb22 req-f622a20b-c8ed-4641-8017-8b0249da12b4 service nova] Creating event network-vif-plugged:bd8ccecb-2a4e-4685-b380-393cb3e7838f for instance c4349547-2d12-4277-955a-38e90a338d8d on hv-cinder-84980 Jul 14 10:16:42.422873 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-88618b0a-d6da-4fb0-adbb-5ced4ae7bb22 req-f622a20b-c8ed-4641-8017-8b0249da12b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Jul 14 10:16:42.423701 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 191/369] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:42.712822 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:42.714076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:42.720406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:42.721230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:42.722012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:42.722457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:42.868298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:42.873722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:42.874515 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:42.878544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1acf53b4-6b80-46e4-95cd-aeb775401179 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1710 microversion: 2.1 time: 0.170582 Jul 14 10:16:42.879646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 179/370] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:42 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:42.881207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:42.881915 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:42.882769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:42.883449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:43.022347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:43.030751 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ef5626d6-74fb-438c-942d-8a71beb1bcd0 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.161428 Jul 14 10:16:43.031313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 192/371] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:42 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:43.895294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:43.895899 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:43.903211 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:43.903767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:43.904571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:43.905044 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:44.041136 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:44.047472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:44.048090 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:44.049179 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-001c33de-04ad-41a9-bf22-7b20a9f95fd9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1714 microversion: 2.1 time: 0.157599 Jul 14 10:16:44.049744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 180/372] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:43 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:44.055330 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:44.055784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:44.056563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:44.057029 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:44.183939 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:44.191359 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0c279012-f8b7-411e-9ab2-237296a77cc9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.147660 Jul 14 10:16:44.191897 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 193/373] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:44 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:45.209468 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:45.210876 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:45.217124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:45.217659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:45.218513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:45.219030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:45.235014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:45.374252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:45.378158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-475c377d-6b69-4fa1-b7e0-d8de190c3e3a tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.172016 Jul 14 10:16:45.379275 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 181/374] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:45 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:46.395971 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:46.396591 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:46.404004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:46.404464 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:46.405267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:46.405707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:46.409804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:46.534161 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:46.542261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d9703716-01f5-4b70-84d8-4421aac4f03d tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.150126 Jul 14 10:16:46.542827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 194/375] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:46 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:47.558550 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:47.559219 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:47.566247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:47.566703 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:47.567487 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:47.567927 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:47.696332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:47.704891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8a0b25d0-9afe-4510-8db3-5b6049bfc138 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1315 microversion: 2.1 time: 0.150193 Jul 14 10:16:47.705629 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 182/376] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:47 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:48.722550 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:48.723159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:48.730226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:48.730688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:48.731441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:48.731875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:49.104767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:49.112355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-98b4b78d-48ac-4c57-a80d-20ae5c0a362b tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1465 microversion: 2.1 time: 0.393636 Jul 14 10:16:49.112917 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 195/377] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:48 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1465 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:49.150873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:49.151634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:49.158078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:49.158566 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:49.159333 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:49.159776 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:49.184419 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:16:49.256416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-80f9b32e-0639-40dc-8df2-e23a674e58ce tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 204 len: 0 microversion: 2.1 time: 0.109901 Jul 14 10:16:49.257021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 183/378] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:16:49 2022] DELETE /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:16:49.265771 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:49.266384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:49.272493 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:49.272972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:49.273742 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:49.274204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:49.407430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:49.414968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a5a402e1-723e-437d-86d1-274981a75bcc tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1471 microversion: 2.1 time: 0.153115 Jul 14 10:16:49.415533 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 196/379] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:49 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:50.432512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:50.433243 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:50.439551 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:50.439997 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:50.440749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:50.441203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:50.573459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:50.580961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-828bbce3-94a6-4003-a151-a3e2755058de tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1471 microversion: 2.1 time: 0.152623 Jul 14 10:16:50.581526 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 184/380] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:50 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:51.598659 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:51.599268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:51.606460 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:51.606912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:51.607675 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:51.608114 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:51.741930 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:51.750922 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4a3bb0bd-926a-473c-abb5-3859b5abccf2 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1471 microversion: 2.1 time: 0.156017 Jul 14 10:16:51.751533 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 197/381] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:51 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:52.768559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:52.769297 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:52.777224 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:52.777747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:52.778722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:52.779350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:52.926574 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:52.936001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-44421f8a-98b4-4619-ac35-55cdf8289700 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1471 microversion: 2.1 time: 0.170927 Jul 14 10:16:52.936975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 185/382] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:52 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:16:53.295721 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-51e09b31-9bbd-40bd-961a-6a499aa919f9 req-2934055b-5c4c-4d7c-93e6-555a95ea8425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4349547-2d12-4277-955a-38e90a338d8d", "name": "network-vif-deleted", "tag": "bd8ccecb-2a4e-4685-b380-393cb3e7838f"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:16:53.299690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=70 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:53.305526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-51e09b31-9bbd-40bd-961a-6a499aa919f9 req-2934055b-5c4c-4d7c-93e6-555a95ea8425 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:53.305974 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-51e09b31-9bbd-40bd-961a-6a499aa919f9 req-2934055b-5c4c-4d7c-93e6-555a95ea8425 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:53.318710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-51e09b31-9bbd-40bd-961a-6a499aa919f9 req-2934055b-5c4c-4d7c-93e6-555a95ea8425 service nova] Creating event network-vif-deleted:bd8ccecb-2a4e-4685-b380-393cb3e7838f for instance c4349547-2d12-4277-955a-38e90a338d8d on hv-cinder-84980 Jul 14 10:16:53.324722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-51e09b31-9bbd-40bd-961a-6a499aa919f9 req-2934055b-5c4c-4d7c-93e6-555a95ea8425 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032505 Jul 14 10:16:53.326601 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 198/383] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:16:53.959349 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:53.959961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:53.963014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:16:53.968505 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:53.969076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:53.969910 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:53.970348 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:54.002654 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:54.003111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:54.003564 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lazy-loading 'fault' on Instance uuid c4349547-2d12-4277-955a-38e90a338d8d {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:16:54.049695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '994f748d68504033a95385b1ab507d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47163a6d0e704f8eb8d0725284918f86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:16:54.057095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-eaeddbbb-0914-4c7c-bcbf-0f2a6c104165 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 200 len: 1305 microversion: 2.1 time: 0.101592 Jul 14 10:16:54.057662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 186/384] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:53 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:16:55.075844 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:16:55.076441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] [instance: c4349547-2d12-4277-955a-38e90a338d8d] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:16:55.082623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:55.083068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:55.083823 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:16:55.084255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:16:55.098020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] HTTP exception thrown: Instance c4349547-2d12-4277-955a-38e90a338d8d could not be found. Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Request method failure captured: Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d HTTP/1.1 Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-z7WGRcd85ZQuF20J96aM2VTIw2K4_Cbc6jX8xusJPr4Xn4o6bBrWXY5covTgSRuiCa210HdH5nmgQIrJNNoOM0D66tjqW64DpWxg7C27DMpqMpN_cJ9HbM6FQjScz6iDFnBI5tQAUWWAG93APxh81oVi4ji_uAERjvp4N-QGF6TLQ Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 47163a6d0e704f8eb8d0725284918f86 Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesNegativeTest-594270807 Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:16:55.099594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_47163a6d0e704f8eb8d0725284918f86", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47163a6d0e704f8eb8d0725284918f86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/47163a6d0e704f8eb8d0725284918f86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/47163a6d0e704f8eb8d0725284918f86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesNegativeTest-594270807 Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 47163a6d0e704f8eb8d0725284918f86 Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesNegativeTest-594270807 Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesNegativeTest-594270807-project Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 994f748d68504033a95385b1ab507d85 Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesNegativeTest-594270807-project Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance c4349547-2d12-4277-955a-38e90a338d8d could not be found. Jul 14 10:16:55.101204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'c4349547-2d12-4277-955a-38e90a338d8d'} Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4349547-2d12-4277-955a-38e90a338d8d could not be found. Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:16:55.102116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4349547-2d12-4277-955a-38e90a338d8d could not be found. Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4349547-2d12-4277-955a-38e90a338d8d could not be found. Jul 14 10:16:55.103891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:16:55.105066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] Returning 404 to user: Instance c4349547-2d12-4277-955a-38e90a338d8d could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:16:55.105066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c48b279c-bcfe-49ba-ba00-c8053cad67f9 tempest-VolumesNegativeTest-594270807 tempest-VolumesNegativeTest-594270807-project] 10.222.0.61 "GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d" status: 404 len: 111 microversion: 2.1 time: 0.030416 Jul 14 10:16:55.105066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 199/385] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:16:55 2022] GET /compute/v2.1/servers/c4349547-2d12-4277-955a-38e90a338d8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:06.904576 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6bc69c6f-6a40-46b1-ab23-3b5f4011eeb4", "device": "/dev/sdb"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:06.906435 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:06.912982 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:06.914162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:06.916479 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:06.917038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:06.918067 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:06.918705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:07.265193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-69c64ffd-9e2d-4775-b4d0-6d64883508c6 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "POST /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365120 Jul 14 10:17:07.265875 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 187/386] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:17:06 2022] POST /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:12.462428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:12.463416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=26 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:12.656538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d75d736f-25ab-451f-944d-8e8c614ac31c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Action: 'create', calling method: .version_select at 0x7f5625a64940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2142394265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCkRMw33Blq+Kp0dIgdF54MTwaBuHFkhn4EQzNrEtJ/K4v74mojN8VZmtgzekUEG9SBxC1+jOQyYvW+WVZwku+2Mmo5RPK5rRUyl0t2UZV47aa656eIV3HgvTMtgwQvyw=="}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:12.672687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-d75d736f-25ab-451f-944d-8e8c614ac31c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:17:12.679961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-d75d736f-25ab-451f-944d-8e8c614ac31c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for user 8cd8f0490c6949cbba431b0b317683fd and project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:17:12.713109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d75d736f-25ab-451f-944d-8e8c614ac31c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256736 Jul 14 10:17:12.719404 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 200/387] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:17:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:32.148548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:32.149784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:32.154412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:32.154996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:32.162458 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:32.162917 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:32.163919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:32.164360 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:32.303808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lazy-loading 'services' on Instance uuid 5164f3a1-116c-47db-8d85-1e34b56e4018 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:17:32.423936 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0e6d14a0-8b9a-4c47-a5a4-85c8b8418d76 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018/os-volume_attachments/6bc69c6f-6a40-46b1-ab23-3b5f4011eeb4" status: 202 len: 0 microversion: 2.1 time: 0.276685 Jul 14 10:17:32.424578 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 188/388] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:17:32 2022] DELETE /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018/os-volume_attachments/6bc69c6f-6a40-46b1-ab23-3b5f4011eeb4 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:17:33.576079 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:33.577945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:33.582312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:33.583105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:33.593221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:33.593221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:33.594071 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:33.594571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:33.620678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:17:33.699367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-15fff888-5cdb-412a-97dc-4a1f858f7c9b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 204 len: 0 microversion: 2.1 time: 0.124424 Jul 14 10:17:33.700092 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 201/389] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:17:33 2022] DELETE /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:17:33.709100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:33.709830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:33.717156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:33.717680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:33.718836 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:33.719355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:33.856614 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:33.864235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-11913b16-ed8a-4e16-8cef-63e6a00a6920 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1513 microversion: 2.1 time: 0.159841 Jul 14 10:17:33.864789 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 189/390] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:33 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:17:34.881787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:34.882395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:34.889472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:34.890082 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:34.890862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:34.891304 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:35.021919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:35.030312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-955891ec-6fbd-436a-bd44-267ea46e2bbe tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1513 microversion: 2.1 time: 0.152343 Jul 14 10:17:35.031050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 202/391] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:34 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:36.047166 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:36.047785 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:36.054301 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.054749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.055507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:36.055943 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:36.192120 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:36.199610 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b68ad808-a169-43b8-a1fd-fd70a4f86fcc tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1513 microversion: 2.1 time: 0.156295 Jul 14 10:17:36.200182 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 190/392] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:36 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:37.215520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:37.216137 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:37.223320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:37.223774 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:37.224536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:37.225007 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:37.365956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:37.373663 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1311e5c4-0edd-4186-a63b-3fd1333dad9a tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 200 len: 1513 microversion: 2.1 time: 0.161973 Jul 14 10:17:37.374233 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 203/393] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:37 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:37.730955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-1f5e4d77-698c-4f1f-9157-11355349a527 req-b752b464-239e-4528-8398-af2351404128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5164f3a1-116c-47db-8d85-1e34b56e4018", "name": "network-vif-deleted", "tag": "4fe03bab-cecb-4477-ab70-6692900e70c5"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:37.744714 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-1f5e4d77-698c-4f1f-9157-11355349a527 req-b752b464-239e-4528-8398-af2351404128 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:37.745180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-1f5e4d77-698c-4f1f-9157-11355349a527 req-b752b464-239e-4528-8398-af2351404128 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:37.757564 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-1f5e4d77-698c-4f1f-9157-11355349a527 req-b752b464-239e-4528-8398-af2351404128 service nova] Creating event network-vif-deleted:4fe03bab-cecb-4477-ab70-6692900e70c5 for instance 5164f3a1-116c-47db-8d85-1e34b56e4018 on hv-cinder-84980 Jul 14 10:17:37.762719 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-1f5e4d77-698c-4f1f-9157-11355349a527 req-b752b464-239e-4528-8398-af2351404128 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035276 Jul 14 10:17:37.763302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 191/394] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:38.390413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:38.391063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 5164f3a1-116c-47db-8d85-1e34b56e4018] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:38.397552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:38.398007 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:38.398775 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:38.399217 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:38.413307 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] HTTP exception thrown: Instance 5164f3a1-116c-47db-8d85-1e34b56e4018 could not be found. Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Request method failure captured: Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 HTTP/1.1 Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-zqj8-A7WrPRuXmW0aSOJVEMLa9mzSlP5UbfTxxHWNDosONXuLkV5MJCgG2j2iOOM6Av860X-mZUCaS0DUMZEQKJPh2mOmAoNaqCMefGnbz38PHzuWYWtmvJmjCFA0mJ8e3CWq8UKjf-pUCSypzMlQA9SexF_jpYhmMMRuJuYCvEks Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: a2eeff0739c1463383b618c4c56ae344 Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598501893 Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:17:38.415043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2eeff0739c1463383b618c4c56ae344", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2eeff0739c1463383b618c4c56ae344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2eeff0739c1463383b618c4c56ae344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2eeff0739c1463383b618c4c56ae344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesSnapshotTestJSON-598501893 Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: a2eeff0739c1463383b618c4c56ae344 Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598501893 Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesSnapshotTestJSON-598501893-project Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 9eebb3ed7b2342efbd3eb4e72329c1e3 Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesSnapshotTestJSON-598501893-project Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 5164f3a1-116c-47db-8d85-1e34b56e4018 could not be found. Jul 14 10:17:38.416987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '5164f3a1-116c-47db-8d85-1e34b56e4018'} Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5164f3a1-116c-47db-8d85-1e34b56e4018 could not be found. Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:17:38.417893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5164f3a1-116c-47db-8d85-1e34b56e4018 could not be found. Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5164f3a1-116c-47db-8d85-1e34b56e4018 could not be found. Jul 14 10:17:38.419313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:17:38.421461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Returning 404 to user: Instance 5164f3a1-116c-47db-8d85-1e34b56e4018 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:17:38.421461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5cdbe42f-7537-4f3b-b203-c20f288f7b73 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018" status: 404 len: 111 microversion: 2.1 time: 0.029826 Jul 14 10:17:38.421461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 204/395] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:38 2022] GET /compute/v2.1/servers/5164f3a1-116c-47db-8d85-1e34b56e4018 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:17:43.802507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-586172454", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2142394265", "security_groups": [{"name": "tempest-secgroup-smoke-957205412"}], "block_device_mapping_v2": [{"uuid": "fe84980a-4b51-4bbd-99d8-f83f89b27379", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a5bd4dd-229b-4523-a623-35c0c9078f3c"}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:43.932155 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] validate_networks() for [('6a5bd4dd-229b-4523-a623-35c0c9078f3c', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:17:44.335042 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:17:44.335462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:17:44.335961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:17:44.336373 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:17:44.336781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:17:44.345461 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.345904 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.346729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:44.347151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:44.363904 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:17:44.368038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for user 8cd8f0490c6949cbba431b0b317683fd and project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:17:44.428324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:17:44.430544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe84980a-4b51-4bbd-99d8-f83f89b27379',volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:17:44.558016 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6bcab5dc-055e-4e15-b649-25c34446b4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760773 Jul 14 10:17:44.558664 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 192/396] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:17:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:17:44.568812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5bd3c9f9-6700-417d-bcff-e1a4d6c926ee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:44.569543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5bd3c9f9-6700-417d-bcff-e1a4d6c926ee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:44.625812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5bd3c9f9-6700-417d-bcff-e1a4d6c926ee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:44.632584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5bd3c9f9-6700-417d-bcff-e1a4d6c926ee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1094 microversion: 2.1 time: 0.067720 Jul 14 10:17:44.633187 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 205/397] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:44 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:17:45.651003 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:45.651658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:45.658631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:45.659085 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:45.659855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:45.660297 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:45.720235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:45.727533 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c0cbe76d-7862-40bb-b47e-ac13bf9839be tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1144 microversion: 2.1 time: 0.081113 Jul 14 10:17:45.728085 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 193/398] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:45 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:46.743731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:46.744344 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:46.751832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:46.752290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:46.753106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:46.753554 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:46.813260 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:46.820650 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-29f339c6-ba09-4812-bf2a-ce9c91d892db tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1136 microversion: 2.1 time: 0.080819 Jul 14 10:17:46.821240 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 206/399] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:46 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1136 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:47.287958 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-481388044", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "networks": [{"uuid": "0e4c91b4-c74a-406f-b9e7-1f32ae5cd0f4"}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:47.339466 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] validate_networks() for [('0e4c91b4-c74a-406f-b9e7-1f32ae5cd0f4', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:17:47.839965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:47.841592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:47.849303 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.849762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:47.850551 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:47.851026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.088964 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:48.101356 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3852bd3e-21cd-4ec6-8809-0c36c391e30a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1210 microversion: 2.1 time: 0.265501 Jul 14 10:17:48.115863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 207/400] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:47 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1210 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:17:48.174044 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:17:48.175389 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:17:48.175960 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:17:48.176479 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:17:48.177048 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:17:48.205378 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:48.207127 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.208170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:48.208802 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:48.228370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Getting quotas for project a2eeff0739c1463383b618c4c56ae344. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:17:48.234482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Getting quotas for user 9eebb3ed7b2342efbd3eb4e72329c1e3 and project a2eeff0739c1463383b618c4c56ae344. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:17:48.257926 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:17:48.260480 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:17:48.320205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b990ff51-9f7e-452d-b3d3-4eec0ef993dd tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036002 Jul 14 10:17:48.320849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 194/401] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:17:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:17:48.331839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-15f4a388-cf95-4af6-a018-2a08eed96f35 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:48.332470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-15f4a388-cf95-4af6-a018-2a08eed96f35 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:48.405169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-15f4a388-cf95-4af6-a018-2a08eed96f35 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:48.413024 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-15f4a388-cf95-4af6-a018-2a08eed96f35 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1218 microversion: 2.1 time: 0.085021 Jul 14 10:17:48.413598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 208/402] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:48 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:17:49.026073 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-061e2f97-241c-4976-b320-4d367b9a9e65 req-7a7e5822-10b0-49a8-a0fb-a39a1013de0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce402fd6-a9d2-4651-9e76-aa616b99b208", "tag": "4b9960d1-29f9-466d-84b3-07562c942f9c"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:49.042694 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-061e2f97-241c-4976-b320-4d367b9a9e65 req-7a7e5822-10b0-49a8-a0fb-a39a1013de0a service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.044224 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-061e2f97-241c-4976-b320-4d367b9a9e65 req-7a7e5822-10b0-49a8-a0fb-a39a1013de0a service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.057002 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-061e2f97-241c-4976-b320-4d367b9a9e65 req-7a7e5822-10b0-49a8-a0fb-a39a1013de0a service nova] Creating event network-changed:4b9960d1-29f9-466d-84b3-07562c942f9c for instance ce402fd6-a9d2-4651-9e76-aa616b99b208 on hv-cinder-84980 Jul 14 10:17:49.063256 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-061e2f97-241c-4976-b320-4d367b9a9e65 req-7a7e5822-10b0-49a8-a0fb-a39a1013de0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041315 Jul 14 10:17:49.064375 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 195/403] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:17:49.121308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:49.121934 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:49.129460 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.129919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.130726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.131199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.266306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:49.273810 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-180e483e-a34d-4731-95e2-5188b8409ab7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.156402 Jul 14 10:17:49.274385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 209/404] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:49 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:49.431076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:49.431778 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:49.438442 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.438897 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.439673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:49.440108 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:49.553362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:49.563100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-77faf7ce-3be6-4109-8a50-72c88704cdf2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1278 microversion: 2.1 time: 0.136718 Jul 14 10:17:49.564988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 196/405] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:49 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:50.291192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:50.291816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:50.299325 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.299787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.300571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.301044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.527882 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:50.535927 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9e1b1246-6499-4cc6-b317-e463c0371515 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.248656 Jul 14 10:17:50.536498 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 210/406] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:50 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:50.580189 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:50.580813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:50.588797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.589513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.590463 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.591081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.818484 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:50.826332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e12e731a-cc87-4186-b724-be7967220c50 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.250404 Jul 14 10:17:50.827181 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 197/407] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:50 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:50.900770 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-0deef406-ac35-49a2-a979-c82a813d540c req-b61fd38d-abd3-461e-bf27-710ad698994f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b211116-0817-4af5-a5ad-4c6b1eb7de99", "tag": "a6d4464e-33c6-439a-8919-b602661ef654"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:50.911027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-0deef406-ac35-49a2-a979-c82a813d540c req-b61fd38d-abd3-461e-bf27-710ad698994f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:50.911482 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-0deef406-ac35-49a2-a979-c82a813d540c req-b61fd38d-abd3-461e-bf27-710ad698994f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:50.925444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-0deef406-ac35-49a2-a979-c82a813d540c req-b61fd38d-abd3-461e-bf27-710ad698994f service nova] Creating event network-changed:a6d4464e-33c6-439a-8919-b602661ef654 for instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 on hv-cinder-84980 Jul 14 10:17:50.930639 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-0deef406-ac35-49a2-a979-c82a813d540c req-b61fd38d-abd3-461e-bf27-710ad698994f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034227 Jul 14 10:17:50.931248 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 211/408] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:51.553080 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:51.553618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:51.559648 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:51.560148 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:51.560910 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:51.561375 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:51.695001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:51.702416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0e8ec1c1-6206-4c71-9d31-39ae9dcd4a6c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.153260 Jul 14 10:17:51.702980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 198/409] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:51 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:51.845129 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:51.845878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:51.852180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:51.852639 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:51.853446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:51.853892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:51.987744 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:51.995183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7e2e7817-cb3c-4099-9d9a-0837eb231c47 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.155357 Jul 14 10:17:51.995750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 212/410] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:51 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:52.719391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:52.719993 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:52.726505 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:52.726952 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:52.727698 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:52.728128 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:52.858398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:52.865985 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1b5a6270-4cac-4661-8e1c-8bf034c51a40 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.150628 Jul 14 10:17:52.866576 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 199/411] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:52 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:53.011619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:53.012342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:53.018780 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.019230 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.019989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.020421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.250887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:53.258466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2a7b66fb-414a-4648-8a20-5cf218c6e8c2 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.250703 Jul 14 10:17:53.259024 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 213/412] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:53 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:53.882548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:53.883155 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:53.891346 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.891794 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:53.892561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:53.893032 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:54.027487 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:54.035597 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0dbaeb40-c6e9-4894-8d85-c70d12e3d15d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.156808 Jul 14 10:17:54.036162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 200/413] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:53 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:54.275348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:54.275961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:54.283089 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:54.283550 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:54.284321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:54.284766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:54.411801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:54.419808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-67202013-ea94-4bc7-8b30-aaea0bcae354 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.148110 Jul 14 10:17:54.420416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 214/414] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:54 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:54.977771 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-dd601309-665f-4c1b-9563-d8faef4f60f5 req-3812ba2f-27cd-4c38-85ed-7171fbd53309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b211116-0817-4af5-a5ad-4c6b1eb7de99", "name": "network-vif-plugged", "status": "completed", "tag": "a6d4464e-33c6-439a-8919-b602661ef654"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:54.988799 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-dd601309-665f-4c1b-9563-d8faef4f60f5 req-3812ba2f-27cd-4c38-85ed-7171fbd53309 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:54.989288 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-dd601309-665f-4c1b-9563-d8faef4f60f5 req-3812ba2f-27cd-4c38-85ed-7171fbd53309 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.001116 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-dd601309-665f-4c1b-9563-d8faef4f60f5 req-3812ba2f-27cd-4c38-85ed-7171fbd53309 service nova] Creating event network-vif-plugged:a6d4464e-33c6-439a-8919-b602661ef654 for instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 on hv-cinder-84980 Jul 14 10:17:55.006253 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-dd601309-665f-4c1b-9563-d8faef4f60f5 req-3812ba2f-27cd-4c38-85ed-7171fbd53309 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Jul 14 10:17:55.007268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 201/415] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:55.053077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:55.054226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:55.060449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:55.061087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.061924 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:55.062495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.201663 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:55.209150 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d64e9d9f-ee77-4790-aaab-048f91576968 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.160309 Jul 14 10:17:55.209716 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 215/416] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:55 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:55.438160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:55.439122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:55.445537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:55.445980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.446737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:55.447167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:55.574257 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:55.582405 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-daff704e-2e8d-4049-a2f0-892fb27d8b61 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.149634 Jul 14 10:17:55.582965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 202/417] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:55 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:56.226858 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:56.227472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:56.234812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.239236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.239236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.239236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.374435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:56.381899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2dcd5009-d155-4f6a-a8e9-c352b1ec442a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.159065 Jul 14 10:17:56.382486 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 216/418] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:56 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:56.599093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:56.599622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:56.606051 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.607007 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.607758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:56.608190 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:56.734293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:56.741527 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ef131a4d-6683-469c-ad6c-14606ee6683b tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.146489 Jul 14 10:17:56.742082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 203/419] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:56 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:57.398759 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:57.399624 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:57.406358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.406806 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.407572 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.408003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.541748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:57.549909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3a4cf83e-f4f2-4dc0-b34e-466a58e1f47b tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.154989 Jul 14 10:17:57.550481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 217/420] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:57 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:57.758608 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:57.759203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:57.766303 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.766753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.767519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:57.767956 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:57.895577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:57.903193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8321d24c-9f94-4a67-a475-c6f4be13c5d5 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1318 microversion: 2.1 time: 0.148424 Jul 14 10:17:57.904336 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 204/421] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:57 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:58.568495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:58.569085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:58.571516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:58.577932 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:58.578386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:58.579157 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:58.579597 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:58.723985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:58.732329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f002fdad-e7d9-4da2-aa59-581211878f96 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.167413 Jul 14 10:17:58.732899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 218/422] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:58 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:58.919996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:58.920690 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:58.923133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=4 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:58.923880 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=12 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:58.930383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:58.930838 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:58.931603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:58.932038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:58.989659 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-25fa2296-e074-44fb-be13-c1c7908cdb98 req-5dc20934-fbf0-4710-9b3f-5344db2908d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce402fd6-a9d2-4651-9e76-aa616b99b208", "name": "network-vif-plugged", "status": "completed", "tag": "4b9960d1-29f9-466d-84b3-07562c942f9c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:59.000041 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-25fa2296-e074-44fb-be13-c1c7908cdb98 req-5dc20934-fbf0-4710-9b3f-5344db2908d9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.001017 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-25fa2296-e074-44fb-be13-c1c7908cdb98 req-5dc20934-fbf0-4710-9b3f-5344db2908d9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.005350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:17:59.014291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-25fa2296-e074-44fb-be13-c1c7908cdb98 req-5dc20934-fbf0-4710-9b3f-5344db2908d9 service nova] Creating event network-vif-plugged:4b9960d1-29f9-466d-84b3-07562c942f9c for instance ce402fd6-a9d2-4651-9e76-aa616b99b208 on hv-cinder-84980 Jul 14 10:17:59.019604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-25fa2296-e074-44fb-be13-c1c7908cdb98 req-5dc20934-fbf0-4710-9b3f-5344db2908d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034063 Jul 14 10:17:59.020238 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 219/423] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:17:59.078966 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:59.086632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-06696274-5a90-4122-a86d-2f69a0d76a3c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1507 microversion: 2.1 time: 0.170763 Jul 14 10:17:59.087206 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 205/424] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:58 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:17:59.103989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d6a482f-4557-489e-a66a-7c787fc9e24f", "device": "/dev/sdb"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:17:59.105678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:59.113512 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.113970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.114746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.115187 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.388845 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4896880c-78cf-43fe-91bc-12a373f8829c tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "POST /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288987 Jul 14 10:17:59.389864 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 220/425] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:17:59 2022] POST /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:17:59.749556 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:17:59.750287 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:17:59.756441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.756900 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.757699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:17:59.758143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:17:59.892216 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:17:59.900171 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-00abbc44-3f08-4b88-bf8e-864deb72bdb2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.155065 Jul 14 10:17:59.900741 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 206/426] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:17:59 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:00.918184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:00.918912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:00.925224 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:00.925679 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:00.926442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:00.926884 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:01.064081 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:01.071818 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-98859336-82d7-4738-9034-778e4ac43946 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1265 microversion: 2.1 time: 0.158523 Jul 14 10:18:01.072382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 221/427] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:00 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:01.905465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:01.906010 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:01.912447 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:01.912903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:01.913699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:01.914144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:01.918014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:01.995234 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lazy-loading 'services' on Instance uuid cb5e53dd-665c-4eb7-a9b9-94555c21df75 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:02.070444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c29cb415-0fba-4520-b1bf-6b583c692ae9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-volume_attachments/48357fbc-7064-42cc-a0aa-c438382cded1" status: 202 len: 0 microversion: 2.1 time: 0.169039 Jul 14 10:18:02.071431 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 207/428] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:18:01 2022] DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-volume_attachments/48357fbc-7064-42cc-a0aa-c438382cded1 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:02.088007 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:02.088623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:02.095664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:02.096160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:02.097152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:02.097594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:02.241468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:02.249717 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-353f5b6b-f526-40c2-b5bc-97a21fddf737 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1452 microversion: 2.1 time: 0.165521 Jul 14 10:18:02.250289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 222/429] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:02 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:02.266419 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:02.267111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:02.269052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=6 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:02.274877 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:02.275324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:02.276081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:02.276515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:02.406340 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:02.414171 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-330bc9db-b30a-4a46-be73-c143c9af78d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1452 microversion: 2.1 time: 0.151990 Jul 14 10:18:02.414675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 208/430] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:02 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:03.918709 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:03.919275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:03.921677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:03.928202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:03.928680 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:03.929489 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:03.929979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:03.955200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-080fd292-2d14-4445-9d1a-91e64fe65a37 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/ips" status: 200 len: 149 microversion: 2.1 time: 0.040309 Jul 14 10:18:03.955999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 223/431] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:18:03 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:03.966197 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9b71032-9cf9-4711-af61-6b41c20ed02f"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:03.967386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:03.974051 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:03.974499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:03.975264 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:03.975700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.054774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Invalid volume: volume f9b71032-9cf9-4711-af61-6b41c20ed02f is already attached to instances: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: POST /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/os-volume_attachments HTTP/1.1 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 74 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:18:04.055783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {"volumeAttachment": {"volumeId": "f9b71032-9cf9-4711-af61-6b41c20ed02f"}} Jul 14 10:18:04.057469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Invalid volume: volume f9b71032-9cf9-4711-af61-6b41c20ed02f is already attached to instances: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'server_id': '48291869-495a-4466-a05f-86a03663c24e', 'body': {'volumeAttachment': {'volumeId': 'f9b71032-9cf9-4711-af61-6b41c20ed02f'}}} Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f9b71032-9cf9-4711-af61-6b41c20ed02f is already attached to instances: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:04.058339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f9b71032-9cf9-4711-af61-6b41c20ed02f is already attached to instances: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:04.060328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f9b71032-9cf9-4711-af61-6b41c20ed02f is already attached to instances: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 400 to user: Invalid volume: volume f9b71032-9cf9-4711-af61-6b41c20ed02f is already attached to instances: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4d73ce17-5ef0-4310-bf38-8e4da81a010f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095025 Jul 14 10:18:04.062077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 209/432] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:18:03 2022] POST /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:18:04.067369 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:04.068049 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:04.076193 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.076743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.077618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.078356 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.103982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:18:04.179403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ff1a3cee-0692-4d3c-bcfb-0eca28cd633c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 204 len: 0 microversion: 2.1 time: 0.115618 Jul 14 10:18:04.179998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 224/433] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:18:04 2022] DELETE /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:18:04.189553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:04.190222 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:04.200498 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.201445 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.202424 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.203288 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.385418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-0a84eae3-75e5-4780-8a21-8fe5f4d2c663 req-6f602013-541d-48ab-a928-731b713c33de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce402fd6-a9d2-4651-9e76-aa616b99b208", "tag": "4b9960d1-29f9-466d-84b3-07562c942f9c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:04.385622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:04.393817 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-29b178dd-99fd-4b0e-a392-a1981a7bd51d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1681 microversion: 2.1 time: 0.208858 Jul 14 10:18:04.394515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 210/434] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:04 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:04.402686 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-0a84eae3-75e5-4780-8a21-8fe5f4d2c663 req-6f602013-541d-48ab-a928-731b713c33de service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:04.403887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-0a84eae3-75e5-4780-8a21-8fe5f4d2c663 req-6f602013-541d-48ab-a928-731b713c33de service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:04.415611 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-0a84eae3-75e5-4780-8a21-8fe5f4d2c663 req-6f602013-541d-48ab-a928-731b713c33de service nova] Creating event network-changed:4b9960d1-29f9-466d-84b3-07562c942f9c for instance ce402fd6-a9d2-4651-9e76-aa616b99b208 on hv-cinder-84980 Jul 14 10:18:04.421144 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-0a84eae3-75e5-4780-8a21-8fe5f4d2c663 req-6f602013-541d-48ab-a928-731b713c33de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040264 Jul 14 10:18:04.421740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 225/435] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:18:05.413034 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:05.413646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:05.420140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:05.420592 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:05.421389 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:05.421825 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:05.551171 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:05.558502 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b9450dc5-4583-4c92-a3db-a54a6955fae2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1681 microversion: 2.1 time: 0.149399 Jul 14 10:18:05.559087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 211/436] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:05 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:06.577260 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:06.578003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:06.584175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:06.584622 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:06.585418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:06.585854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:06.728947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:06.743546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a3d3909e-5668-4181-9ef6-6716af3218e7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1681 microversion: 2.1 time: 0.171576 Jul 14 10:18:06.744386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 226/437] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:06 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:07.760493 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:07.761036 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:07.767685 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:07.768118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:07.768881 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:07.769350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:07.977447 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:07.990135 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4eb6a1d4-86e5-498c-ad02-25c15fd3df70 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1681 microversion: 2.1 time: 0.233430 Jul 14 10:18:07.991955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 212/438] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:07 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:08.261457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-20d0ccfd-4656-4a94-9283-9403052b597c req-0ee28ed0-17fc-4672-96b2-e2ba6ce4eadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48291869-495a-4466-a05f-86a03663c24e", "name": "network-vif-deleted", "tag": "f62e512c-782f-43f9-802d-0be372fe0a8b"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:08.274962 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-20d0ccfd-4656-4a94-9283-9403052b597c req-0ee28ed0-17fc-4672-96b2-e2ba6ce4eadd service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:08.277050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-20d0ccfd-4656-4a94-9283-9403052b597c req-0ee28ed0-17fc-4672-96b2-e2ba6ce4eadd service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:08.296298 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-20d0ccfd-4656-4a94-9283-9403052b597c req-0ee28ed0-17fc-4672-96b2-e2ba6ce4eadd service nova] Creating event network-vif-deleted:f62e512c-782f-43f9-802d-0be372fe0a8b for instance 48291869-495a-4466-a05f-86a03663c24e on hv-cinder-84980 Jul 14 10:18:08.302276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-20d0ccfd-4656-4a94-9283-9403052b597c req-0ee28ed0-17fc-4672-96b2-e2ba6ce4eadd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057464 Jul 14 10:18:08.303153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 227/439] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:08.483471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3cd2f138-4fd4-4466-8001-49b55bc9e4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:08.489661 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3cd2f138-4fd4-4466-8001-49b55bc9e4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:08.490226 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3cd2f138-4fd4-4466-8001-49b55bc9e4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:08.512139 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3cd2f138-4fd4-4466-8001-49b55bc9e4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Going to try to stop instance {{(pid=117810) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 10:18:08.557220 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3cd2f138-4fd4-4466-8001-49b55bc9e4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action" status: 202 len: 0 microversion: 2.1 time: 0.077955 Jul 14 10:18:08.558248 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 213/440] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:18:08 2022] POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:08.567262 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:08.567969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:08.574481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:08.575090 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:08.576026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:08.576464 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:08.650069 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9697504-5009-41f8-bfb3-f28ca2beea56"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:08.651808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:08.660365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:08.661088 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:08.662034 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:08.662572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:08.734078 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:08.742434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8f8cefcf-992f-42b5-ba06-ac2035e7f2c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.179672 Jul 14 10:18:08.743549 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 228/441] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:08 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:09.008076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:09.008860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:09.015207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:09.015661 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:09.016441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:09.016876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:09.048965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:09.049666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:09.050122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'fault' on Instance uuid 48291869-495a-4466-a05f-86a03663c24e {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:09.093728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:09.101473 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4ffa4613-11c3-4f45-b3bb-579c576f0482 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1331 microversion: 2.1 time: 0.097534 Jul 14 10:18:09.102053 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 229/442] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:09 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:09.760748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:09.761415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:09.768037 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:09.768490 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:09.769285 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:09.769724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:09.902418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:09.910715 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9d004fa4-c698-47da-b451-87ef5520ebe8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.153896 Jul 14 10:18:09.911296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 230/443] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:09 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:10.118539 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:10.119155 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:10.125980 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:10.126433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:10.127202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:10.127645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:10.159081 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:10.159532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:10.159988 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'fault' on Instance uuid 48291869-495a-4466-a05f-86a03663c24e {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:10.200521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:10.208006 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ea71fb01-731c-4dd4-9ea5-2078e804755f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1331 microversion: 2.1 time: 0.093388 Jul 14 10:18:10.208567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 231/444] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:10 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:10.928370 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:10.929063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:10.936040 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:10.936485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:10.937408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:10.937827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:11.064027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:11.071564 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8f392845-137f-4e39-a9c7-b8f40bad9962 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.147044 Jul 14 10:18:11.072224 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 232/445] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:10 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:11.225718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:11.226244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:11.232238 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:11.232687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:11.233473 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:11.233915 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:11.267195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:11.267647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:11.268100 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'fault' on Instance uuid 48291869-495a-4466-a05f-86a03663c24e {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:11.312320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:11.319779 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a45c7d4d-7154-40f2-923d-c2c754f2d0a5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 200 len: 1331 microversion: 2.1 time: 0.098373 Jul 14 10:18:11.320343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 233/446] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:11 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:11.894861 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7cb70bfe-5838-460d-8c96-ba289f8d2911 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.250400 Jul 14 10:18:11.895618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 214/447] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:18:08 2022] POST /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments => generated 194 bytes in 3252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:12.088968 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:12.089584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:12.096502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:12.096987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:12.097752 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:12.098192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:12.102196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:12.229418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:12.236964 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-37a52b57-1ce2-4881-9f1d-c114e42aad9d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.151833 Jul 14 10:18:12.237529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 234/448] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:12 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:12.337422 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:12.338265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:12.344974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:12.345692 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:12.346483 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:12.346917 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:12.362182 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e HTTP/1.1 Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:18:12.363830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:18:12.365758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '48291869-495a-4466-a05f-86a03663c24e'} Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:18:12.370443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:18:12.372708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:12.374074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:18:12.374074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3b415b06-b959-47a0-a6ac-1a27739deec9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 404 len: 111 microversion: 2.1 time: 0.032554 Jul 14 10:18:12.374074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 215/449] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:12 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:18:12.375291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-84b0122c-285a-4e86-ae9a-e118b7b56474 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '.version_select at 0x7f562664c040>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:12.395153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-84b0122c-285a-4e86-ae9a-e118b7b56474 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196615512" status: 202 len: 0 microversion: 2.1 time: 0.024677 Jul 14 10:18:12.400309 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 235/450] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jul 14 10:18:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1196615512 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:13.046492 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:13.047011 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:13.053449 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:13.053962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:13.054714 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:13.055083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:13.134383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'services' on Instance uuid 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:13.204853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d1397498-402a-40a4-aff9-895769b9304b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments/f9b71032-9cf9-4711-af61-6b41c20ed02f" status: 202 len: 0 microversion: 2.1 time: 0.162702 Jul 14 10:18:13.205498 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 216/451] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:18:13 2022] DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments/f9b71032-9cf9-4711-af61-6b41c20ed02f => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:13.214378 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:13.215324 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:13.222089 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:13.222538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:13.223314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:13.223826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:13.254169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5ce78e4a-cdd6-4811-be72-ccfcfedca828 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Jul 14 10:18:13.254895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 236/452] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:13 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:13.255548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:13.256314 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:13.263397 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:13.263843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:13.264623 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:13.265092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:13.401660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:13.409754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e2428bd8-9816-409e-b44b-ee9034d330d5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.158753 Jul 14 10:18:13.410324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 217/453] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:13 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:14.265195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:14.266123 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:14.272857 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:14.273278 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:14.274303 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:14.274740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:14.303790 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8ecda7bb-067e-4fe1-bdba-0840c07fbec1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042613 Jul 14 10:18:14.304327 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 237/454] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:14 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:14.426671 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:14.427269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:14.434229 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:14.434716 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:14.435465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:14.435895 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:14.563378 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:14.570854 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d105b1ed-01dd-4168-9069-e4da211a7481 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.148052 Jul 14 10:18:14.571417 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 218/455] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:14 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:15.316008 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:15.316874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:15.323454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:15.323916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:15.325361 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:15.325805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:15.354641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5d4b579b-2f65-4ede-90af-bc13ca5001ab tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042642 Jul 14 10:18:15.355224 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 238/456] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:15 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:15.588299 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:15.588912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:15.596740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:15.597222 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:15.597981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:15.598413 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:15.728880 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:15.737158 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ffe6af8a-37f4-49e5-91a7-c4156855ef2f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.152335 Jul 14 10:18:15.737840 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 219/457] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:15 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:16.366207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:16.367071 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:16.374623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:16.375084 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:16.375853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:16.376294 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:16.406163 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b03c785e-19ae-48ce-85ab-9c22cc20806e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Jul 14 10:18:16.406708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 239/458] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:16 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:16.755585 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:16.756186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:16.765239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:16.765689 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:16.766458 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:16.766941 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:16.899683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:16.903868 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:16.908650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-689f7ac0-e67a-488d-aa41-c655c7c3087a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.156924 Jul 14 10:18:16.909265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 220/459] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:16 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:17.417653 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:17.419153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:17.425771 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:17.426227 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:17.426996 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:17.427438 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:17.456746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9510eaa9-6948-40bb-9817-45c8bd159608 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Jul 14 10:18:17.457272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 240/460] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:17 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:17.926097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:17.926693 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:17.934869 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:17.935323 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:17.936092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:17.936532 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:18.072297 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:18.081995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5bf1f824-a5c1-4fbb-8450-3d1dd00153cd tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.159740 Jul 14 10:18:18.082576 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 221/461] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:17 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:18.470080 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:18.471002 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:18.477623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:18.478112 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:18.478877 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:18.479313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:18.508134 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-67064f54-6c9b-42c5-a102-5b81e50c54c1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Jul 14 10:18:18.508689 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 241/462] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:18 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:19.099639 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:19.100214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:19.108115 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.108673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.109474 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.109917 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.245435 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:19.253853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2bc799a4-1604-409f-8a25-a26f9b5e1e29 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.158184 Jul 14 10:18:19.254429 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 222/463] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:19 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:19.391151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:19.392102 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:19.398437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.399153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.399926 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.400369 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.423407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lazy-loading 'flavor' on Instance uuid 97b52dc3-0452-4872-b526-d4fce9ef4e93 {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:19.519675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:19.520758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:19.531220 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.531881 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.532712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.533685 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.566398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1b24fed7-e403-4dd2-8d9e-886c3efdbfa0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050583 Jul 14 10:18:19.567340 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 223/464] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:19 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:18:19.591412 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1d682d0b-05af-4425-bd28-75b49bdd824b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/action" status: 200 len: 32 microversion: 2.1 time: 0.204703 Jul 14 10:18:19.592196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 242/465] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:18:19 2022] POST /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:18:19.601363 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:19.602005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:19.608308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.608769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.609766 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.610165 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.744570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:19.753174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6ac5040b-050e-4e9f-b71d-572f94be7ec0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.155679 Jul 14 10:18:19.753744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 224/466] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:19 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:19.907147 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:19.907736 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:19.914054 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.914508 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:19.915272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:19.915714 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.040623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lazy-loading 'services' on Instance uuid 7b211116-0817-4af5-a5ad-4c6b1eb7de99 {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:20.159219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f5ff8005-66a6-4870-b261-30b5d28fde30 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99/os-volume_attachments/6d6a482f-4557-489e-a66a-7c787fc9e24f" status: 202 len: 0 microversion: 2.1 time: 0.256254 Jul 14 10:18:20.159838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 243/467] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:18:19 2022] DELETE /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99/os-volume_attachments/6d6a482f-4557-489e-a66a-7c787fc9e24f => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:20.271054 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:20.271675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:20.279837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.280291 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.281103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.281547 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.417712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:20.425400 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-79f29a07-16c5-45eb-9cca-386ab707450d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.158205 Jul 14 10:18:20.425970 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 225/468] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:20 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:20.579772 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:20.580838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:20.587644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.588124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.588895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.589365 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.617585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-bad6fa64-04db-4276-83ec-c954e3db26c7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043254 Jul 14 10:18:20.618220 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 244/469] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:18:20 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:18:20.677239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:20.677754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:20.684830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.685391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.686246 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.686751 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.711875 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:18:20.771718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:20.772904 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:20.779552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.780138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.781078 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.781588 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.798553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-56e94461-a319-4c9d-b6c6-4ec8da541fd5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 204 len: 0 microversion: 2.1 time: 0.125068 Jul 14 10:18:20.799279 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 226/470] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:18:20 2022] DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:18:20.807860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:20.808787 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:20.815569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.816103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.816909 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:20.817397 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:20.971750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:20.980030 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e3096bae-d019-4224-98d0-0aca38e897e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.212546 Jul 14 10:18:20.981366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 245/471] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:20 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:20.998267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:21.005701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-94ce92d7-fa4c-4dd2-91d1-9dadd80b8e47 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1680 microversion: 2.1 time: 0.202076 Jul 14 10:18:21.006264 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 227/472] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:20 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1680 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:21.442190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:21.442898 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:21.449000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:21.450052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:21.450853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:21.451297 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:21.581773 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:21.589382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e2720c61-fa75-4aa2-8f50-3464dda86545 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.150948 Jul 14 10:18:21.590011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 246/473] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:21 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:21.997695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:21.998300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:22.004731 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:22.005219 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:22.005964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:22.006396 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:22.023091 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:22.024116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:22.030926 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:22.031382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:22.032157 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:22.032625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:22.204107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:22.208451 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:22.212284 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a527ffd6-761a-4412-8036-d09f8708f7be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.218345 Jul 14 10:18:22.212864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 228/474] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:21 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:22.216981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3d058baa-b849-4a65-9475-47cb78320249 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1680 microversion: 2.1 time: 0.197726 Jul 14 10:18:22.217547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 247/475] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:22 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:22.607036 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:22.607599 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:22.613763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:22.614215 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:22.615078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:22.615525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:22.741593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:22.749663 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a98b0443-9d2f-4319-b408-b078f924c9e6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.146641 Jul 14 10:18:22.750236 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 229/476] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:22 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:23.229547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:23.230066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:23.233203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:23.233811 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:23.237329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.237784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.238556 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.238999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.244899 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.245386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.246177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.247175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.442359 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:23.444965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:23.451718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f5525396-ccab-4546-b79f-104af60d1021 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.226046 Jul 14 10:18:23.452488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 248/477] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:23 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:23.453341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cc345a5a-36d8-4417-a82d-4acab0bd925c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1680 microversion: 2.1 time: 0.224312 Jul 14 10:18:23.454034 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 230/478] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:23 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:23.457396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:23.457899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:23.463896 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.464355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.465702 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.466153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.470233 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:23.492892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:18:23.570959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7e784abb-c392-4f6a-82ed-b3b2065f79d4 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 204 len: 0 microversion: 2.1 time: 0.117244 Jul 14 10:18:23.571734 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 249/479] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:18:23 2022] DELETE /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:18:23.581026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:23.581867 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:23.588006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.588537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.589432 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.590500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.724820 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:23.732706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-91869771-8b53-4d2d-8e19-8e776d93e602 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1513 microversion: 2.1 time: 0.156272 Jul 14 10:18:23.733385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 231/480] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:23 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:23.767795 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:23.768497 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:23.774858 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.775306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.776066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:23.776495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:23.907514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:23.914924 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3e56cbfb-0479-4e4a-bc6b-ae0c0cea0374 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.151585 Jul 14 10:18:23.915699 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 250/481] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:23 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:24.193566 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-b0de161d-594b-4a42-a32c-78bf913b6e9e req-cd44062f-8dbc-4aec-afb1-20d7b51cabff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ac6d8d-492d-45da-ac13-5688fc6e2bb6", "name": "network-vif-deleted", "tag": "81f609dc-8842-42ec-9605-22d13d78fb55"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:24.202223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-b0de161d-594b-4a42-a32c-78bf913b6e9e req-cd44062f-8dbc-4aec-afb1-20d7b51cabff service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.202666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-b0de161d-594b-4a42-a32c-78bf913b6e9e req-cd44062f-8dbc-4aec-afb1-20d7b51cabff service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.213736 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-b0de161d-594b-4a42-a32c-78bf913b6e9e req-cd44062f-8dbc-4aec-afb1-20d7b51cabff service nova] Creating event network-vif-deleted:81f609dc-8842-42ec-9605-22d13d78fb55 for instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 on hv-cinder-84980 Jul 14 10:18:24.219678 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-b0de161d-594b-4a42-a32c-78bf913b6e9e req-cd44062f-8dbc-4aec-afb1-20d7b51cabff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029839 Jul 14 10:18:24.220294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 232/482] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:24.469526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:24.470219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:24.470930 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:24.471741 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:24.477366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.477835 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.478529 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.478646 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.478975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.479088 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.479752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.480192 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.573027 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:24.583630 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-71fe6d6f-bddc-4bc1-b415-4707dd346435 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1612 microversion: 2.1 time: 0.117251 Jul 14 10:18:24.584549 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 233/483] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:24 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1612 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:24.647810 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:24.656622 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fb167d97-e03b-4d41-bd6b-ea7c36e574ed tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.191104 Jul 14 10:18:24.657228 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 251/484] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:24 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:24.750953 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:24.751982 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:24.760012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.760462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.761269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.761755 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.892367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:24.900473 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-47cea73f-a308-41dc-9677-41e57d2ffccf tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1513 microversion: 2.1 time: 0.154431 Jul 14 10:18:24.901074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 234/485] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:24 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:24.931393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:24.932028 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:24.938543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.939090 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:24.939871 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:24.940323 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.076710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:25.085350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a5e7e2e1-1455-4f65-8266-654491536099 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.157685 Jul 14 10:18:25.085935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 252/486] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:24 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:25.601687 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:25.602406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:25.609617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.610073 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.610845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.611289 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.643803 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.644171 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.644622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'fault' on Instance uuid 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:25.674264 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:25.674850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:25.681335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.681787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.682541 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.683073 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.685587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:25.693307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4633196b-68e3-4bab-8bdc-d329b8008de9 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 200 len: 1330 microversion: 2.1 time: 0.095482 Jul 14 10:18:25.693923 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 235/487] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:25 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:25.811306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:25.819184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c1e2e1aa-b542-4d5e-9dfb-afcdc9229e60 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.148748 Jul 14 10:18:25.819744 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 253/488] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:25 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:25.918512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:25.919117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:25.925175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.925622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.926370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:25.926800 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:25.930792 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:26.060944 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eebb3ed7b2342efbd3eb4e72329c1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2eeff0739c1463383b618c4c56ae344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:26.068667 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ea6ef862-305e-4fa9-b070-4b2df146cc89 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 200 len: 1513 microversion: 2.1 time: 0.154463 Jul 14 10:18:26.069464 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 236/489] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:25 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:26.102765 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:26.103638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:26.110470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.110923 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.112057 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.112502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.256254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:26.263904 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d840fff2-99a8-4615-a386-9d332fb42100 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.164971 Jul 14 10:18:26.264476 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 254/490] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:26 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:26.539486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-d02e6674-8b2a-444b-bc60-491c7e68c326 req-b5f74aab-ba1b-419e-ae1d-2257818ada44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b211116-0817-4af5-a5ad-4c6b1eb7de99", "name": "network-vif-deleted", "tag": "a6d4464e-33c6-439a-8919-b602661ef654"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:26.550804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-d02e6674-8b2a-444b-bc60-491c7e68c326 req-b5f74aab-ba1b-419e-ae1d-2257818ada44 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.551252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-d02e6674-8b2a-444b-bc60-491c7e68c326 req-b5f74aab-ba1b-419e-ae1d-2257818ada44 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.562661 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-d02e6674-8b2a-444b-bc60-491c7e68c326 req-b5f74aab-ba1b-419e-ae1d-2257818ada44 service nova] Creating event network-vif-deleted:a6d4464e-33c6-439a-8919-b602661ef654 for instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 on hv-cinder-84980 Jul 14 10:18:26.568013 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-d02e6674-8b2a-444b-bc60-491c7e68c326 req-b5f74aab-ba1b-419e-ae1d-2257818ada44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Jul 14 10:18:26.568652 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 237/491] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:26.710169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:26.710854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:26.717850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.718300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.719060 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.719500 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.732853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 HTTP/1.1 Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:18:26.734477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:18:26.735990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '79ac6d8d-492d-45da-ac13-5688fc6e2bb6'} Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:18:26.736881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:18:26.738316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:26.739582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:18:26.739582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1dd7ca34-d84f-4b32-b80d-514fe6f69470 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 404 len: 111 microversion: 2.1 time: 0.029536 Jul 14 10:18:26.739582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 255/492] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:26 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:18:26.745609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-58183937-a46e-40bc-b888-771fbf265d0d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '.version_select at 0x7f56258f0f70>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:26.764004 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-58183937-a46e-40bc-b888-771fbf265d0d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219532342" status: 202 len: 0 microversion: 2.1 time: 0.022972 Jul 14 10:18:26.764552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 238/493] 10.222.0.61 () {58 vars in 1217 bytes} [Thu Jul 14 10:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219532342 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:26.836449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:26.837190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:26.845886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.846385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.847321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:26.847789 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:26.999219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:27.009860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a2291471-0e39-49c1-a9d6-9e809387f4a5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.177356 Jul 14 10:18:27.010674 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 256/494] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:26 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:27.085850 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:27.087030 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] [instance: 7b211116-0817-4af5-a5ad-4c6b1eb7de99] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:27.094357 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:27.095029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:27.096001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:27.096637 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:27.113157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] HTTP exception thrown: Instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 could not be found. Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Request method failure captured: Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 HTTP/1.1 Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-zqj8-A7WrPRuXmW0aSOJVEMLa9mzSlP5UbfTxxHWNDosONXuLkV5MJCgG2j2iOOM6Av860X-mZUCaS0DUMZEQKJPh2mOmAoNaqCMefGnbz38PHzuWYWtmvJmjCFA0mJ8e3CWq8UKjf-pUCSypzMlQA9SexF_jpYhmMMRuJuYCvEks Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a2eeff0739c1463383b618c4c56ae344 Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-598501893 Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:18:27.114815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2eeff0739c1463383b618c4c56ae344", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2eeff0739c1463383b618c4c56ae344"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2eeff0739c1463383b618c4c56ae344"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2eeff0739c1463383b618c4c56ae344"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-VolumesSnapshotTestJSON-598501893 Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a2eeff0739c1463383b618c4c56ae344 Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-598501893 Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-VolumesSnapshotTestJSON-598501893-project Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 9eebb3ed7b2342efbd3eb4e72329c1e3 Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-VolumesSnapshotTestJSON-598501893-project Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 could not be found. Jul 14 10:18:27.116383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '7b211116-0817-4af5-a5ad-4c6b1eb7de99'} Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 could not be found. Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:18:27.117151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 could not be found. Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 could not be found. Jul 14 10:18:27.118313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:18:27.121545 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] Returning 404 to user: Instance 7b211116-0817-4af5-a5ad-4c6b1eb7de99 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:18:27.122427 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3c55128d-d9b2-4019-b69f-92bf9fb2f227 tempest-VolumesSnapshotTestJSON-598501893 tempest-VolumesSnapshotTestJSON-598501893-project] 10.222.0.61 "GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99" status: 404 len: 111 microversion: 2.1 time: 0.040598 Jul 14 10:18:27.122990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 239/495] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:27 2022] GET /compute/v2.1/servers/7b211116-0817-4af5-a5ad-4c6b1eb7de99 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:18:27.281886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:27.282846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:27.290987 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:27.291453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:27.292384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:27.293508 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:27.460709 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:27.469382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-52167f04-17e8-4578-840b-6b62d62109f6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1678 microversion: 2.1 time: 0.191968 Jul 14 10:18:27.470161 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 257/496] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:27 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:27.483953 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b22b28ff-fda7-4aa7-8d95-fc365e84836a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: .version_select at 0x7f56258f0f70>, body: {"keypair": {"name": "tempest-keypair-1763612660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4dw/dEPq1zWt+RTCXhwFKzSJtbOtNzJQKJdOn6ugZZuH8BDnyfdoUN1K9VSGWkcXK+iXD/QIRj9N4AFPoWySo0bxse6b+ifXX0VWIGOmHC4fHxmSqaQZ3OuMPSJkbXKA=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:27.498327 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-b22b28ff-fda7-4aa7-8d95-fc365e84836a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:18:27.502317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-b22b28ff-fda7-4aa7-8d95-fc365e84836a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:18:27.524004 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b22b28ff-fda7-4aa7-8d95-fc365e84836a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043655 Jul 14 10:18:27.524596 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 240/497] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:18:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:28.028020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:28.028593 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:28.035106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:28.035551 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:28.036314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:28.036747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:28.242047 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:28.252747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f3a821d9-a83d-4282-b977-d5e0d93a4bd2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.228922 Jul 14 10:18:28.261816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 258/498] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:28 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:28.487191 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:28.487803 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:28.494735 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:28.495429 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:28.497102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:28.497748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:28.888120 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:28.896132 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9ddd5ac7-7a5a-4092-a186-d018cddedfd8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1655 microversion: 2.1 time: 0.413150 Jul 14 10:18:28.896973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 241/499] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:28 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1655 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:28.913439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ba871ce6-b14f-4355-97e6-cec8c952c11d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:28.919529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ba871ce6-b14f-4355-97e6-cec8c952c11d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:28.920084 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ba871ce6-b14f-4355-97e6-cec8c952c11d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:28.942420 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ba871ce6-b14f-4355-97e6-cec8c952c11d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Going to try to start instance {{(pid=117809) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 10:18:28.987469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ba871ce6-b14f-4355-97e6-cec8c952c11d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action" status: 202 len: 0 microversion: 2.1 time: 0.077446 Jul 14 10:18:28.989009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 259/500] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:18:28 2022] POST /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:28.997083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:28.997702 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:29.005612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.006492 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.007339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.007790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.106308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-341233034", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f"}], "security_groups": [{"name": "tempest-securitygroup--1104735509"}], "key_name": "tempest-keypair-1763612660", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:29.140476 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:29.149224 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-56ffa856-ae25-4d3f-be2e-a52d6e228abf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1664 microversion: 2.1 time: 0.155951 Jul 14 10:18:29.149793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 242/501] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:28 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:29.211064 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] validate_networks() for [('2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:18:29.269399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:29.270008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:29.276462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.276913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.278249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.278686 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.476812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:29.486428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a17fe5e9-7d44-42cd-a101-131daeaf71d6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.220987 Jul 14 10:18:29.487321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 243/502] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:29 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:29.638860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:18:29.639317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:18:29.639788 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:18:29.640198 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:18:29.640609 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:18:29.650192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.650640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.651434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.651870 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.664066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:29.671302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:18:29.675929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:18:29.687413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:18:29.689828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:18:29.690622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:29.691165 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:29.697149 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.697602 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.698371 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.698812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.728086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lazy-loading 'flavor' on Instance uuid 414a7fe2-8b90-4d6a-a2d0-884211f8d41f {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:18:29.741389 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-782650d7-e80e-429d-a4f7-308c29298854 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.640605 Jul 14 10:18:29.742208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 260/503] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:18:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 10:18:29.751592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d918c512-61cf-42fc-84b8-082d17497910 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:29.752207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d918c512-61cf-42fc-84b8-082d17497910 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:29.820186 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d918c512-61cf-42fc-84b8-082d17497910 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:29.821990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f9af5f64-4bfb-4128-b672-46c14ec1372c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "POST /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f/action" status: 202 len: 0 microversion: 2.1 time: 0.134958 Jul 14 10:18:29.822595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 244/504] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:18:29 2022] POST /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:18:29.829546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d918c512-61cf-42fc-84b8-082d17497910 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1241 microversion: 2.1 time: 0.081532 Jul 14 10:18:29.830132 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 261/505] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:29 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:29.832142 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:29.832842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:29.842220 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.842631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.843395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:29.843827 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:29.980688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:29.988386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e99d2119-1b44-4786-b835-196a8a50637c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.160780 Jul 14 10:18:29.989174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 245/506] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:29 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:30.166463 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:30.167099 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:30.173851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:30.174300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:30.175052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:30.175485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:30.304824 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:30.312750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7d9cdbd7-46b1-4ceb-8588-c82b1072deea tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1664 microversion: 2.1 time: 0.150156 Jul 14 10:18:30.313341 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 262/507] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:30 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:30.503637 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:30.504145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:30.510790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:30.511238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:30.512000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:30.512439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:30.639793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:30.647697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d428949d-692d-4b12-81e6-27f5abea948c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.148054 Jul 14 10:18:30.648251 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 246/508] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:30 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:30.846662 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:30.847194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:30.853226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:30.853685 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:30.854458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:30.854902 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:30.915630 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:30.923108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d285cc6d-5a21-41ca-a9b0-693da9788018 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1245 microversion: 2.1 time: 0.080405 Jul 14 10:18:30.923945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 263/509] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:30 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:31.006349 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:31.006963 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:31.013702 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.014152 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.014915 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.015356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.146856 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:31.154662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-133ba3ea-00bc-48f0-93ba-acb31739e4b0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.152115 Jul 14 10:18:31.155235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 247/510] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:31 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:31.330481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:31.331085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:31.337246 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.337695 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.338447 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.338880 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.469283 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:31.480271 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-10eb9549-1f0f-44b5-8ae4-95b03c45f758 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1664 microversion: 2.1 time: 0.152828 Jul 14 10:18:31.481672 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 264/511] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:31 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:31.666529 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:31.667058 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:31.669812 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:31.675168 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.675627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.676407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.676852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.843703 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:31.851668 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5c5c515a-c1be-4db5-b9eb-ebc7aeaeeb30 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.189813 Jul 14 10:18:31.852245 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 248/512] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:31 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:31.939828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:31.940468 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:31.946635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.947186 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.948407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:31.949399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:31.969296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:32.014993 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:32.022493 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ee14b68c-0ac7-4cef-806a-e8888f622dcc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1293 microversion: 2.1 time: 0.086578 Jul 14 10:18:32.023063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 265/513] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:31 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:32.171391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:32.172335 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:32.183888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:32.184324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:32.185177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:32.185613 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:32.406843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:32.415245 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-efe63234-9487-47f4-8405-7b14386a71fd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.247685 Jul 14 10:18:32.415981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 249/514] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:32 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:32.498207 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:32.498823 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:32.505131 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:32.505590 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:32.506364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:32.506868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:32.683872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:32.692194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8f855423-92e8-4583-a0d0-806ea5ee5750 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1664 microversion: 2.1 time: 0.197921 Jul 14 10:18:32.692801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 266/515] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:32 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1664 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:32.869362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:32.869960 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:32.877046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:32.877407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:32.878163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:32.878598 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.048507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:33.049354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:33.055465 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:33.055912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.056687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:33.057162 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.069248 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:33.078230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c5071db4-bef1-46f7-8f8e-09a9650de61c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.212621 Jul 14 10:18:33.079563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 250/516] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:32 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:33.275099 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:33.284748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5849bd64-cd9f-49de-8e03-1d48a12a9679 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.239646 Jul 14 10:18:33.285358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 267/517] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:33 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:33.432090 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:33.432699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:33.439321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:33.439780 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.440550 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:33.440999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.575766 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:33.585432 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8a35c7c8-00a0-4f2e-acfa-aeb25bcc359f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.157073 Jul 14 10:18:33.597534 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 251/518] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:33 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:33.709032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:33.709821 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:33.716983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:33.717445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.718215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:33.718654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:33.930228 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:33.938506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ab9c3598-f133-43e5-afe8-e24e28b720c8 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1668 microversion: 2.1 time: 0.233330 Jul 14 10:18:33.939090 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 268/519] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:33 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:34.095571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:34.096213 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:34.103921 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.104690 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.106272 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.110386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.302186 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:34.306956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:34.314268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.314720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.315546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.315990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.326618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:34.337165 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fd8e9ced-c2e6-4221-93ea-726a168eeb8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.245300 Jul 14 10:18:34.347566 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 252/520] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:34 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:34.353855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-b68e2829-1ba5-43a3-bc5b-9f20269fd2b5 req-607e80b2-0073-4777-b5e4-cd0940becfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e077b2f-2c84-41d9-9f6d-d8a4637b2fad", "tag": "5176281a-87a4-47dd-9b90-45bcffacb063"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:34.379454 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-b68e2829-1ba5-43a3-bc5b-9f20269fd2b5 req-607e80b2-0073-4777-b5e4-cd0940becfe7 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.379907 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-b68e2829-1ba5-43a3-bc5b-9f20269fd2b5 req-607e80b2-0073-4777-b5e4-cd0940becfe7 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.397457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-b68e2829-1ba5-43a3-bc5b-9f20269fd2b5 req-607e80b2-0073-4777-b5e4-cd0940becfe7 service nova] Creating event network-changed:5176281a-87a4-47dd-9b90-45bcffacb063 for instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad on hv-cinder-84980 Jul 14 10:18:34.403290 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-b68e2829-1ba5-43a3-bc5b-9f20269fd2b5 req-607e80b2-0073-4777-b5e4-cd0940becfe7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054151 Jul 14 10:18:34.404074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 253/521] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:34.586922 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:34.601945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9100ff55-909d-4e84-86b6-b4fc750d9f19 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.303541 Jul 14 10:18:34.605486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:34.607736 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:34.612429 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 269/522] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:34 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:34.623150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.623849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.624712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:34.625282 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:34.858458 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:34.862081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:34.867304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7cfc57d7-c3dd-4fde-8f73-e1e20b2fa473 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.266876 Jul 14 10:18:34.867866 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 254/523] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:34 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:35.354603 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:35.355781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:35.362409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:35.362855 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:35.363615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:35.364080 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:35.489577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:35.497651 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-93d8eff5-45e6-49f2-88da-2b25473b80b7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.146896 Jul 14 10:18:35.498219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 270/524] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:35 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:35.619961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:35.620675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:35.628068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:35.628515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:35.629314 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:35.629752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:35.758662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:35.767026 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c4c4c08b-3372-43ac-ac20-5e2559146fe0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.150971 Jul 14 10:18:35.767663 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 255/525] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:35 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:35.890666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:35.891281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:35.900110 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:35.900620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:35.901427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:35.902216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:36.035845 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:36.043991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0e360f61-cd13-4c99-800b-db0c220b0178 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.162543 Jul 14 10:18:36.044553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 271/526] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:35 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:36.515619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:36.516197 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:36.522442 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:36.522890 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:36.524274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:36.524717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:36.651134 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:36.659882 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2c326667-8ad1-498e-ac14-de8e101bd2ca tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.148985 Jul 14 10:18:36.660456 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 256/527] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:36 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:36.783981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:36.784509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:36.791013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:36.791456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:36.792208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:36.792700 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:36.918267 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:36.926166 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e2bc3d17-7145-4c24-a41e-3943a2a54e4c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.145994 Jul 14 10:18:36.926751 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 272/528] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:36 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:37.061066 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:37.061588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:37.067634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:37.068060 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:37.068815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:37.069274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:37.203196 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:37.210688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9901c018-3a8a-4e4f-b2eb-85de2cb5055f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.153622 Jul 14 10:18:37.211257 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 257/529] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:37 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:37.676918 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:37.677558 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:37.684177 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:37.684650 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:37.685450 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:37.685885 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:37.809923 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:37.818704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2ddb9eb5-71a9-4084-a0ca-b38db1d7696c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.145645 Jul 14 10:18:37.819271 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 273/530] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:37 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:37.943425 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:37.943961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:37.945891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=4 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:37.951665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:37.952059 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:37.952823 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:37.953294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:38.082066 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:38.090925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-818e81c6-8450-4518-a9b1-e3edd72cf649 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.149951 Jul 14 10:18:38.090925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 258/531] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:37 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:38.227633 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:38.228175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:38.234970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:38.235430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:38.236203 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:38.236687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:38.366040 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:38.374051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-14fc290f-cf59-4a2a-b92e-c9d635154a56 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.150411 Jul 14 10:18:38.374609 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 274/532] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:38 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:38.835785 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:38.836403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:38.842496 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:38.842952 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:38.843713 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:38.844163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:38.978647 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:38.987859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3195831f-ea72-4874-bf9e-d7ecebf3b68f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.156172 Jul 14 10:18:38.988623 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 259/533] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:38 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:39.107731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:39.108984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:39.118985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:39.121237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:39.122352 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:39.124036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:39.289214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:39.296680 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4240f28f-c448-4241-ab26-85f47e4bd83a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.194182 Jul 14 10:18:39.297309 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 275/534] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:39 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:39.390960 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:39.391487 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:39.397612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:39.398089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:39.399113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:39.399547 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:39.530429 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:39.537923 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f3e9fa9e-6416-4230-be47-c814a59e99ca tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.150806 Jul 14 10:18:39.538504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 260/535] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:39 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:40.009729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:40.010344 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:40.012193 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:40.013007 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=8 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:40.019119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.019575 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.020347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.020894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.165064 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:40.175455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-afe40b87-3dd5-4c7c-b377-ec6e068d8baa tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.169462 Jul 14 10:18:40.176238 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 276/536] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:40 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:40.315094 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:40.316368 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:40.324120 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.324855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.326500 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.327462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.465861 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:40.474169 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7931f662-bf33-4b13-9ac9-81eddfed25c2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.164336 Jul 14 10:18:40.474748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 261/537] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:40 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:40.555657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:40.556734 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:40.563321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.563883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.564868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.565455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.773930 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:40.782791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-05638f5b-05b6-4dbb-ad11-db75479bb8f1 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.230305 Jul 14 10:18:40.793715 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 277/538] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:40 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:40.814784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-de07fb4a-17f9-4d66-ac18-d13343278d7a req-f7ff3c57-78fb-4a64-9df3-c509bc34e246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e077b2f-2c84-41d9-9f6d-d8a4637b2fad", "name": "network-vif-plugged", "status": "completed", "tag": "5176281a-87a4-47dd-9b90-45bcffacb063"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:40.823923 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-de07fb4a-17f9-4d66-ac18-d13343278d7a req-f7ff3c57-78fb-4a64-9df3-c509bc34e246 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:40.824566 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-de07fb4a-17f9-4d66-ac18-d13343278d7a req-f7ff3c57-78fb-4a64-9df3-c509bc34e246 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:40.835724 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-de07fb4a-17f9-4d66-ac18-d13343278d7a req-f7ff3c57-78fb-4a64-9df3-c509bc34e246 service nova] Creating event network-vif-plugged:5176281a-87a4-47dd-9b90-45bcffacb063 for instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad on hv-cinder-84980 Jul 14 10:18:40.841412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-de07fb4a-17f9-4d66-ac18-d13343278d7a req-f7ff3c57-78fb-4a64-9df3-c509bc34e246 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030268 Jul 14 10:18:40.842303 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 262/539] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:41.193383 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:41.194030 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:41.201323 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:41.201786 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:41.202565 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:41.203011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:41.345078 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:41.353226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ad92ff01-b4a1-428c-957f-02befea93df2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1737 microversion: 2.1 time: 0.163759 Jul 14 10:18:41.353797 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 278/540] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:41 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:41.491874 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:41.492810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:41.499858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:41.500380 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:41.501190 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:41.501633 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:41.635732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:41.643685 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d51f8b51-f4cd-43a6-ab94-205e588302bf tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.156764 Jul 14 10:18:41.644255 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 263/541] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:41 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:41.799437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:41.800001 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:41.805951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:41.806449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:41.807209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:41.807647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:41.946250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:41.954273 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-94341d18-fa7a-4c52-a06c-83413307ba9e tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.158889 Jul 14 10:18:41.954842 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 279/542] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:41 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:42.370312 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:42.371448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:42.377546 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.378000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.378787 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.379223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.512908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:42.520845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-74bdd313-16e0-4338-a46a-5a911927facf tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1717 microversion: 2.1 time: 0.154665 Jul 14 10:18:42.521437 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 264/543] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:42 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:42.625200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:42.625671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:42.631994 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.632442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.633234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.633668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.661584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:42.662393 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:42.669079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.669530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.670301 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.670736 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.720194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] HTTP exception thrown: Cannot 'detach_volume' instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 while it is in vm_state rescued Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Request method failure captured: Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments/d9697504-5009-41f8-bfb3-f28ca2beea56 HTTP/1.1 Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmF_Dc5KK5U5RdOgCMFwTKCWRHcGY1SqAkKmXT9zqBHXLhW5Hy9gSLv7K34Pgdyv9-5xDIuGCEvIc-LU5hPPiY-CYtXCZHwT22mfzAVgT0-Lo9gKnjdYpdAPVBB2qeBWa_3tXTpi-vRR3BDRDONwkjsji7kPVoDokgsHaGocluCAk Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:18:42.721846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_76e4caaf5b9e49678bc6427b71560f19", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: ca339e26746a4feaaa25b14be59479a4 Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:18:42.723417 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Cannot 'detach_volume' instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 while it is in vm_state rescued Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'server_id': '97b52dc3-0452-4872-b526-d4fce9ef4e93', 'id': 'd9697504-5009-41f8-bfb3-f28ca2beea56'} Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:18:42.724197 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 while it is in vm_state rescued Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 while it is in vm_state rescued Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:18:42.725743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Returning 409 to user: Cannot 'detach_volume' instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 while it is in vm_state rescued {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:18:42.726886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-66e0b45a-eb55-4022-aa21-86600e40cca4 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments/d9697504-5009-41f8-bfb3-f28ca2beea56" status: 409 len: 152 microversion: 2.1 time: 0.102180 Jul 14 10:18:42.726886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 280/544] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:18:42 2022] DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments/d9697504-5009-41f8-bfb3-f28ca2beea56 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 10:18:42.732391 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:42.732953 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:42.739740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.740199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.741017 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.741467 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.782444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:42.803403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:42.810982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7cea355b-6d50-4fa6-8db1-a192e041d3a8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "POST /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/action" status: 202 len: 0 microversion: 2.1 time: 0.082189 Jul 14 10:18:42.811824 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 281/545] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:18:42 2022] POST /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:18:42.813897 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9b185377-560e-40f6-bb02-1909f63608f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.156987 Jul 14 10:18:42.814475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 265/546] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:42 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:42.820355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:42.821083 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:42.828004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.828462 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.829256 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.829701 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.959707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:42.968214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-cebc4f15-a918-41cb-9297-c30dff66cbd7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1725 microversion: 2.1 time: 0.151893 Jul 14 10:18:42.968769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 282/547] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:42 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:42.971490 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:42.972103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:42.978077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.978530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:42.979295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:42.980358 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:43.115430 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:43.123430 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-61c79ab3-f4ec-4b05-86a9-b248dbecaa55 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.155775 Jul 14 10:18:43.124025 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 266/548] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:42 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:43.831173 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:43.831781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:43.838398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:43.839944 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:43.840708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:43.841182 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:43.976120 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:43.984637 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-59b6f0f5-22c2-4a37-acd4-4c2efb037e83 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1367 microversion: 2.1 time: 0.157238 Jul 14 10:18:43.985400 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 283/549] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:43 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:43.986003 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:43.986703 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:43.993292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:43.993748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:43.994521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:43.994959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:44.132591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:44.142073 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:44.142706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:44.143763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-988420ba-548b-4558-b12a-96bc3f14c4f8 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1725 microversion: 2.1 time: 0.161938 Jul 14 10:18:44.144530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 267/550] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:43 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:44.149199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:44.149654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:44.150428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:44.150841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:44.284101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:44.291582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b7a567cd-9ce8-40cd-a84c-85bd27d3b5b8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.153561 Jul 14 10:18:44.292142 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 284/551] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:44 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:45.001918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:45.002561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:45.009248 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.009705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.010474 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.010918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.147905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:45.156302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d1febf4f-1d20-4149-9376-0ec42a86db09 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1557 microversion: 2.1 time: 0.158345 Jul 14 10:18:45.156875 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 268/552] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:44 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:45.163349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:45.163988 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:45.171303 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.171809 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.172591 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.173239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:45.173347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.173744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:45.179635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.180090 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.180859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.181337 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.260678 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4729912d-93f5-4839-9d87-20515750aec6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091109 Jul 14 10:18:45.261980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 269/553] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:18:45 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:18:45.310422 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:45.311252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:45.317817 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.318274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.319075 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:45.319517 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:45.651321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:45.659104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:45.659645 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fa628c37-2ec2-4d49-9f14-63362989a087 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.354844 Jul 14 10:18:45.660229 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 270/554] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:45 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:45.667638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e0227852-57c1-4cea-a809-885686c9228c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1725 microversion: 2.1 time: 0.507934 Jul 14 10:18:45.668361 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 285/555] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:45 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1725 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:46.596650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-651ded34-553c-470d-b8fb-2a45fcdb4d8d req-807eeea0-a65d-492f-9c2d-8b71906ff8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e077b2f-2c84-41d9-9f6d-d8a4637b2fad", "tag": "5176281a-87a4-47dd-9b90-45bcffacb063"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:46.607721 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-651ded34-553c-470d-b8fb-2a45fcdb4d8d req-807eeea0-a65d-492f-9c2d-8b71906ff8b8 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:46.608176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-651ded34-553c-470d-b8fb-2a45fcdb4d8d req-807eeea0-a65d-492f-9c2d-8b71906ff8b8 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:46.620901 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-651ded34-553c-470d-b8fb-2a45fcdb4d8d req-807eeea0-a65d-492f-9c2d-8b71906ff8b8 service nova] Creating event network-changed:5176281a-87a4-47dd-9b90-45bcffacb063 for instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad on hv-cinder-84980 Jul 14 10:18:46.626019 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-651ded34-553c-470d-b8fb-2a45fcdb4d8d req-807eeea0-a65d-492f-9c2d-8b71906ff8b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033000 Jul 14 10:18:46.626624 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 271/556] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:46.676599 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:46.677306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:46.684364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:46.684817 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:46.685107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:46.685618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:46.685815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:46.686053 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:46.692964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:46.693433 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:46.694210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:46.694651 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:46.890881 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:46.894525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:46.899282 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-49211d3b-fd4b-4b18-a940-914041bef6e0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1725 microversion: 2.1 time: 0.218400 Jul 14 10:18:46.900089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 272/557] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:46 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:46.903400 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e255af39-d40f-48e0-9923-7adcfac86831 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.230594 Jul 14 10:18:46.903966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 286/558] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:46 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:47.918765 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:47.920027 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:47.920152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:47.920880 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:47.928004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:47.928803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:47.931162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:47.931162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:47.931162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:47.931468 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:47.932596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:47.934029 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:47.936969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=100 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:18:48.118311 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:48.126410 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-0e7c9fd0-6f0f-40c4-adb5-0ae7c648c441 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.210795 Jul 14 10:18:48.127092 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 287/559] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:47 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:48.164794 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:48.173437 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a2f07ef0-b4b1-48e3-aab9-c24b629c4207 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1731 microversion: 2.1 time: 0.260305 Jul 14 10:18:48.173995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 273/560] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:47 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:48.189835 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:48.190342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:48.196345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:48.196804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:48.197616 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:48.198085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:48.277044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4b499192-4ef0-4211-8e91-df5a3687fb4e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090621 Jul 14 10:18:48.277641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 288/561] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:18:48 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:49.143732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:49.144661 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:49.152525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:49.153144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:49.154170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:49.154856 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:49.167046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-1a33892e-a57e-4764-846a-493d097eb1fa req-c49a84a1-f274-47ef-9e95-01eea057a972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b52dc3-0452-4872-b526-d4fce9ef4e93", "tag": "b40b14ad-171e-4c6c-a909-36191cb0c933"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:49.179237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-1a33892e-a57e-4764-846a-493d097eb1fa req-c49a84a1-f274-47ef-9e95-01eea057a972 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:49.187026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-1a33892e-a57e-4764-846a-493d097eb1fa req-c49a84a1-f274-47ef-9e95-01eea057a972 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:49.200398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-1a33892e-a57e-4764-846a-493d097eb1fa req-c49a84a1-f274-47ef-9e95-01eea057a972 service nova] Creating event network-changed:b40b14ad-171e-4c6c-a909-36191cb0c933 for instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 on hv-cinder-84980 Jul 14 10:18:49.205688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-1a33892e-a57e-4764-846a-493d097eb1fa req-c49a84a1-f274-47ef-9e95-01eea057a972 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042850 Jul 14 10:18:49.206371 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 289/562] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:49.320736 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:49.328458 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f796283c-a72c-4fe5-8c41-c030ddb7f077 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.188770 Jul 14 10:18:49.329146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 274/563] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:49 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:50.346503 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:50.347841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:50.355174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:50.355657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:50.356444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:50.356885 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:50.504965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:50.513454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2fe1ddb3-4eb4-40fb-9a16-5b4882120e01 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1566 microversion: 2.1 time: 0.171355 Jul 14 10:18:50.514109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 290/564] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:50 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:50.530563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:50.531136 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:50.538714 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:50.539472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:50.540441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:50.540988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:50.639412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6a33d57f-5fd9-4722-93f7-7db7cc088411 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "POST /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f/action" status: 202 len: 0 microversion: 2.1 time: 0.113015 Jul 14 10:18:50.640034 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 275/565] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:18:50 2022] POST /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:18:50.655218 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:50.655961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:50.663215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:50.663696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:50.664476 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:50.665060 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:50.901749 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:50.910339 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b57e9670-9415-4028-a717-c94d41d5b4f0 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1574 microversion: 2.1 time: 0.266056 Jul 14 10:18:50.911174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 291/566] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:50 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1574 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:51.220741 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-0446376a-6a2e-47fa-a5e4-e06b04256ba9 req-dfda7637-ee6f-4c4b-88f4-46750eb0f8cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97b52dc3-0452-4872-b526-d4fce9ef4e93", "tag": "b40b14ad-171e-4c6c-a909-36191cb0c933"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:51.228977 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-0446376a-6a2e-47fa-a5e4-e06b04256ba9 req-dfda7637-ee6f-4c4b-88f4-46750eb0f8cc service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:51.229525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-0446376a-6a2e-47fa-a5e4-e06b04256ba9 req-dfda7637-ee6f-4c4b-88f4-46750eb0f8cc service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:51.242701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-0446376a-6a2e-47fa-a5e4-e06b04256ba9 req-dfda7637-ee6f-4c4b-88f4-46750eb0f8cc service nova] Creating event network-changed:b40b14ad-171e-4c6c-a909-36191cb0c933 for instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 on hv-cinder-84980 Jul 14 10:18:51.248475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-0446376a-6a2e-47fa-a5e4-e06b04256ba9 req-dfda7637-ee6f-4c4b-88f4-46750eb0f8cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031392 Jul 14 10:18:51.249096 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 276/567] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:51.927731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:51.928340 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:51.935212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:51.935448 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:51.936216 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:51.936655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:52.073616 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:52.082032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-84329fef-ca53-404f-afc7-3bba361e4900 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1516 microversion: 2.1 time: 0.158191 Jul 14 10:18:52.082865 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 292/568] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:51 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:53.103040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:53.103749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:53.111740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:53.112203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:53.113008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:53.113455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:53.251777 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:53.260717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-339fe4b5-91fd-4603-b2ca-98a51015ff80 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.161695 Jul 14 10:18:53.261591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 277/569] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:53 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:54.279345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:54.279956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:54.286606 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:54.287052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:54.287816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:54.288248 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:54.418390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:54.427535 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-29f4895a-d835-4a7a-89f4-a60827e683d3 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.152546 Jul 14 10:18:54.428110 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 293/570] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:54 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:54.894012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-79d1fc08-70e0-4a95-a09e-4c6b2c773de3 req-543a6bb5-d34a-4f51-8606-648e53666fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "name": "network-vif-unplugged", "status": "completed", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:18:54.903603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-79d1fc08-70e0-4a95-a09e-4c6b2c773de3 req-543a6bb5-d34a-4f51-8606-648e53666fcd service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:54.904051 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-79d1fc08-70e0-4a95-a09e-4c6b2c773de3 req-543a6bb5-d34a-4f51-8606-648e53666fcd service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:54.915232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-79d1fc08-70e0-4a95-a09e-4c6b2c773de3 req-543a6bb5-d34a-4f51-8606-648e53666fcd service nova] Creating event network-vif-unplugged:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:18:54.920578 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-79d1fc08-70e0-4a95-a09e-4c6b2c773de3 req-543a6bb5-d34a-4f51-8606-648e53666fcd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030293 Jul 14 10:18:54.921204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 278/571] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:18:55.445738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:55.446349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:55.453472 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:55.453926 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:55.454691 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:55.455141 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:55.589008 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:55.596461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-151f52a7-9a7d-44b5-b0f2-cb1df480b7cd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.154685 Jul 14 10:18:55.597039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 294/572] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:55 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:18:56.614980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:56.615696 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:56.621898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:56.622343 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:56.623706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:56.624133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:56.752351 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:56.760036 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c234c834-c5af-4e04-9040-7b1106fe5184 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.149855 Jul 14 10:18:56.760613 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 279/573] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:56 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:57.777218 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:57.777836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:57.784833 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:57.785313 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:57.786075 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:57.786518 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:57.917879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:57.926357 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ceb8e960-b0de-447b-a076-962b9174814d tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.152863 Jul 14 10:18:57.931739 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 295/574] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:57 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:18:58.948461 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:18:58.949106 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:18:58.956280 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:58.956729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:58.957515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:18:58.957951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:18:59.088289 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:18:59.096505 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-268b08a6-70d5-4b5e-804d-1c0b887b8b9a tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.151875 Jul 14 10:18:59.097101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 280/575] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:18:58 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:00.113069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:00.113714 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:00.116564 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:00.122975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:00.124106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:00.124908 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:00.125368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:00.263437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:00.271612 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-db349f52-ee67-40b3-9513-6c53dc8b8bbc tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.162444 Jul 14 10:19:00.272189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 296/576] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:00 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:01.288701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:01.289337 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:01.295907 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:01.296362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:01.297822 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:01.298267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:01.427889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:01.435618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1baea296-989a-446f-9362-54076b8f62dd tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1572 microversion: 2.1 time: 0.151197 Jul 14 10:19:01.436194 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 281/577] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:01 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:02.454078 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:02.454918 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:02.461303 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:02.461754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:02.462521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:02.462958 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:02.594745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:02.602275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c4d84b01-6f73-40e6-9c6c-0611bda527c7 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1559 microversion: 2.1 time: 0.154400 Jul 14 10:19:02.602849 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 297/578] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:02 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:05.001093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-9ec8fded-c695-485b-a8e9-1aca3e4491ba req-6b75fc2f-6646-4143-a6d7-7380a28f2dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "name": "network-vif-plugged", "status": "completed", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:05.005133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=70 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:05.010882 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-9ec8fded-c695-485b-a8e9-1aca3e4491ba req-6b75fc2f-6646-4143-a6d7-7380a28f2dc9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:05.011331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-9ec8fded-c695-485b-a8e9-1aca3e4491ba req-6b75fc2f-6646-4143-a6d7-7380a28f2dc9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:05.023306 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-9ec8fded-c695-485b-a8e9-1aca3e4491ba req-6b75fc2f-6646-4143-a6d7-7380a28f2dc9 service nova] Creating event network-vif-plugged:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:19:05.028617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-9ec8fded-c695-485b-a8e9-1aca3e4491ba req-6b75fc2f-6646-4143-a6d7-7380a28f2dc9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 Jul 14 10:19:05.029462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 282/579] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:19:20.590776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:20.591702 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:20.594184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:20.594834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:20.600418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:20.600939 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:20.601666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:20.602104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:20.634427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c3394213-5c1f-4106-b574-d0a3feb1bc9f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047547 Jul 14 10:19:20.634973 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 298/580] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:20 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:19:20.691613 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:20.692343 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:20.696353 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:20.697005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:20.704780 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:20.705267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:20.706047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:20.706479 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:20.731462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:19:20.804341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-266aed42-44e9-485f-9432-f870cf121f38 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 204 len: 0 microversion: 2.1 time: 0.114206 Jul 14 10:19:20.804950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 283/581] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:19:20 2022] DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:19:20.815170 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:20.815787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:20.822071 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:20.822615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:20.823466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:20.824105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:20.955133 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:20.962574 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6a0143ed-ee55-4a63-bea3-5f084dd5b625 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1674 microversion: 2.1 time: 0.153297 Jul 14 10:19:20.963136 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 299/582] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:20 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:21.980268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:21.980993 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:21.987419 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:21.987874 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:21.988638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:21.989111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:22.118729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:22.126778 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a9e5f5d8-10d3-463c-9324-4263e786ff3a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1674 microversion: 2.1 time: 0.150723 Jul 14 10:19:22.127367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 284/583] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:21 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:23.144694 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:23.145357 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:23.152060 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:23.152508 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:23.153287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:23.153820 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:23.285110 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:23.292506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4fad1485-0f7a-46fb-b61d-7cb9205a1031 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1674 microversion: 2.1 time: 0.152189 Jul 14 10:19:23.293089 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 300/584] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:23 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:24.310337 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:24.311066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:24.323720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:24.324542 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:24.325650 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:24.327831 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:24.373269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:24.374036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:24.374678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lazy-loading 'fault' on Instance uuid cb5e53dd-665c-4eb7-a9b9-94555c21df75 {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:19:24.391341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-c6870a48-71ed-496a-931e-5f64feb3bdb6 req-6e62dd78-8d07-4b0f-8aca-c80e7565be9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb5e53dd-665c-4eb7-a9b9-94555c21df75", "name": "network-vif-deleted", "tag": "60884b85-920e-41c7-b0fe-f0bd7728bc60"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:24.408504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-c6870a48-71ed-496a-931e-5f64feb3bdb6 req-6e62dd78-8d07-4b0f-8aca-c80e7565be9b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:24.408952 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-c6870a48-71ed-496a-931e-5f64feb3bdb6 req-6e62dd78-8d07-4b0f-8aca-c80e7565be9b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:24.425451 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:24.426351 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-c6870a48-71ed-496a-931e-5f64feb3bdb6 req-6e62dd78-8d07-4b0f-8aca-c80e7565be9b service nova] Creating event network-vif-deleted:60884b85-920e-41c7-b0fe-f0bd7728bc60 for instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 on hv-cinder-84980 Jul 14 10:19:24.431935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-c6870a48-71ed-496a-931e-5f64feb3bdb6 req-6e62dd78-8d07-4b0f-8aca-c80e7565be9b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225489 Jul 14 10:19:24.436384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 285/585] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:24.438699 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e2b4c693-f594-4d71-8bfd-3bdab59fc3a5 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 200 len: 1327 microversion: 2.1 time: 0.132220 Jul 14 10:19:24.439503 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 301/586] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:24 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 1327 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:25.457061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:25.457751 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:25.463992 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:25.464438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:25.465216 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:25.465654 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:25.479202 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] HTTP exception thrown: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Request method failure captured: Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 HTTP/1.1 Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xrJinN3BzM-HZDhGFupsxCT3McFTler_s7jbqXHrwro9Dy5sDcNdiCE83LNh6pHC3jxu_0osd7Qz2hTH4cP4SIiYf2NyuOrYxqbGS4JvXqZ5USMGVsDPxbrJem9CGedGczumkTagwXGOJqd3kvoH1KTgbNQr9oyO4ZbH-PODl0T4k Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:19:25.480737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a4cde0820dc5474eb7091fb3a8de4cd0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 01a9eebc1c8540daa31109cfc86d5ed1 Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:19:25.482367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'cb5e53dd-665c-4eb7-a9b9-94555c21df75'} Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:19:25.483295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:19:25.484768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:25.486185 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Returning 404 to user: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:19:25.486185 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1061e73a-641f-4d1c-8b30-ada39b70fa02 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 404 len: 111 microversion: 2.1 time: 0.030262 Jul 14 10:19:25.486185 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 286/587] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:25 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:19:25.491101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-27fec23c-370f-47bf-8f5d-9e31caea7d40 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '.version_select at 0x7f56258db940>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:25.508595 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-27fec23c-370f-47bf-8f5d-9e31caea7d40 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832275976" status: 202 len: 0 microversion: 2.1 time: 0.021415 Jul 14 10:19:25.509183 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 302/588] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jul 14 10:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1832275976 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:19:26.137867 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e14b347c-4842-4ebd-89d2-caa04e91193f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: .version_select at 0x7f5625830af0>, body: {"keypair": {"name": "tempest-keypair-1821335812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8LHmqhsMIc6FIrM5Etfx/QuaDoAkbREqfBfZzvAxvo9yG3YAKzxVx9PGhO1Y4HyDdbB6db4anfjl3ONrTY//2/xSw/UIiSAUy4/FV48nz93lnUQj1XXTMwbWpREOyDxQ=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:26.152480 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-e14b347c-4842-4ebd-89d2-caa04e91193f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:19:26.156332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-e14b347c-4842-4ebd-89d2-caa04e91193f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for user 01a9eebc1c8540daa31109cfc86d5ed1 and project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:19:26.178315 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e14b347c-4842-4ebd-89d2-caa04e91193f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044362 Jul 14 10:19:26.178889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 287/589] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:19:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:27.596592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-719765929", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71d0e822-864d-4ce6-a81f-385b20a87683"}], "security_groups": [{"name": "tempest-securitygroup--1340252175"}], "key_name": "tempest-keypair-1821335812", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:27.696109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] validate_networks() for [('71d0e822-864d-4ce6-a81f-385b20a87683', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:19:28.374529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:19:28.374946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:19:28.375447 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:19:28.375871 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:19:28.376282 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:19:28.385251 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:28.385693 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:28.386482 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:28.386913 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:28.403812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:19:28.407722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Getting quotas for user 01a9eebc1c8540daa31109cfc86d5ed1 and project a4cde0820dc5474eb7091fb3a8de4cd0. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:19:28.418347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:19:28.421219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:19:28.465799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a739bfeb-a17c-403c-8ce0-15da33cfa56c tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.873956 Jul 14 10:19:28.466439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 303/590] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:19:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:19:28.476217 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fca8a16d-68bf-4c7d-a8b6-c44cb6fdffe1 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:28.476825 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fca8a16d-68bf-4c7d-a8b6-c44cb6fdffe1 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:28.532302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fca8a16d-68bf-4c7d-a8b6-c44cb6fdffe1 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:28.539065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fca8a16d-68bf-4c7d-a8b6-c44cb6fdffe1 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1237 microversion: 2.1 time: 0.066578 Jul 14 10:19:28.549184 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 288/591] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:28 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:29.558176 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:29.558725 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:29.565104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:29.565566 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:29.566345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:29.566791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:29.631156 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:29.639148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-17df8e4f-a34c-43b7-9dae-b7c0f245db1e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1297 microversion: 2.1 time: 0.085554 Jul 14 10:19:29.639862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 304/592] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:29 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:30.225393 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:30.225941 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:30.232476 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:30.233470 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:30.234242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:30.234684 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:30.319725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lazy-loading 'services' on Instance uuid 97b52dc3-0452-4872-b526-d4fce9ef4e93 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:19:30.405437 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-379a508f-a491-4af4-a5fa-dcb87627e7d0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments/d9697504-5009-41f8-bfb3-f28ca2beea56" status: 202 len: 0 microversion: 2.1 time: 0.183320 Jul 14 10:19:30.406022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 289/593] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:19:30 2022] DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments/d9697504-5009-41f8-bfb3-f28ca2beea56 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:19:30.415169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:30.416844 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:30.424666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:30.425162 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:30.426253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:30.426912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:30.469991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-233f01ee-29a4-49c6-aa03-d90989da631b tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059278 Jul 14 10:19:30.474319 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 305/594] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:30 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:30.657684 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:30.658415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:30.664726 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:30.665280 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:30.665996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:30.666439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:30.797619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:30.805053 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0ad7e83c-a276-4001-ac90-1324e9602255 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.152346 Jul 14 10:19:30.805757 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 290/595] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:30 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:31.114777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-a9b0ea9b-fef8-46b7-af9b-f478940771d0 req-9d5b3260-c00f-43ff-94b3-e9f4f88e03d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2418cd-d4dd-4a16-9d70-d601cb1efa76", "tag": "fd9be155-f5da-4d85-b353-8c3d7b3943c6"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:31.126275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a9b0ea9b-fef8-46b7-af9b-f478940771d0 req-9d5b3260-c00f-43ff-94b3-e9f4f88e03d6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.127174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a9b0ea9b-fef8-46b7-af9b-f478940771d0 req-9d5b3260-c00f-43ff-94b3-e9f4f88e03d6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.147300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-a9b0ea9b-fef8-46b7-af9b-f478940771d0 req-9d5b3260-c00f-43ff-94b3-e9f4f88e03d6 service nova] Creating event network-changed:fd9be155-f5da-4d85-b353-8c3d7b3943c6 for instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 on hv-cinder-84980 Jul 14 10:19:31.153152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-a9b0ea9b-fef8-46b7-af9b-f478940771d0 req-9d5b3260-c00f-43ff-94b3-e9f4f88e03d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044029 Jul 14 10:19:31.154343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 306/596] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:31.481615 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:31.483205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:31.489605 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.490066 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.490847 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.491530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.520815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-343d844c-2994-49a7-975f-612b18c70457 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043741 Jul 14 10:19:31.521470 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 291/597] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:31 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:19:31.589009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:31.589601 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:31.596065 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.596529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.597349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.597969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.626133 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:19:31.699631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-386384c0-84a2-4181-9077-41cb395b98f5 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 204 len: 0 microversion: 2.1 time: 0.115063 Jul 14 10:19:31.700264 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 307/598] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:19:31 2022] DELETE /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:19:31.708180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:31.708795 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:31.714853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.715255 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.716020 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.716465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.822786 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:31.823607 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:31.830705 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.831160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.831939 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:31.832383 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:31.843720 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:31.851336 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f1374393-1179-49b3-90d5-351a23b90eae tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1691 microversion: 2.1 time: 0.146924 Jul 14 10:19:31.851898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 292/599] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:31 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:31.967569 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:31.975144 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7415771d-daaf-4a4c-9300-5d079638a4c6 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.156597 Jul 14 10:19:31.975711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 308/600] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:31 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:32.868315 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:32.869000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:32.875635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:32.876089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:32.876854 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:32.877318 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:32.991789 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:32.992314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:32.998716 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:32.999165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:32.999928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:33.000359 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:33.003680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:33.011271 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-382cf6f6-e994-4562-9af5-8d15735b89a1 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1691 microversion: 2.1 time: 0.146880 Jul 14 10:19:33.011834 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 293/601] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:32 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1691 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:33.133769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:33.141184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f2044a4a-5c62-4a9d-89e6-67fa1c04a363 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.153458 Jul 14 10:19:33.141758 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 309/602] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:32 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:33.690322 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:33.690821 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:33.696876 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:33.697352 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:33.698109 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:33.698544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:33.722927 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-584e8684-ad50-425d-bb36-156862026d0c tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/ips" status: 200 len: 150 microversion: 2.1 time: 0.134507 Jul 14 10:19:33.723472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 294/603] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:19:33 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/ips => generated 150 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:34.028786 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:34.029456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:34.035937 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:34.036409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:34.037386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:34.037834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:34.158129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:34.158750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:34.165164 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:34.165636 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:34.166403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:34.166845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:34.168026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:34.175760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-24c5b778-b246-4e8d-9fe0-a2e014a708f0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1691 microversion: 2.1 time: 0.150816 Jul 14 10:19:34.176329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 310/604] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:34 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:34.293729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:34.301116 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-22357004-5808-4a21-8d79-2ab6d6f6f9ed tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.147389 Jul 14 10:19:34.301691 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 295/605] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:34 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:35.040473 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "171a3708-524c-4300-88ce-8621b140987a"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:35.041658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:35.049044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:35.049571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:35.050446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:35.050976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:35.193658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:35.194434 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:35.201244 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:35.201705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:35.203141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:35.203621 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:35.334886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:35.342504 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-134df689-12e2-4a91-ad19-17845eb835fe tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1691 microversion: 2.1 time: 0.152822 Jul 14 10:19:35.343664 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 296/606] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:35 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:35.347941 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:35.348537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:35.354059 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:35.354506 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:35.355260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:35.355694 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:35.482341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:35.489832 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4cd33f8a-f843-4e79-9ff6-a1e523ae2698 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.145226 Jul 14 10:19:35.490530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 297/607] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:35 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:36.360448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:36.361174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:36.367593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:36.368065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:36.368793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:36.369263 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:36.502810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:36.510455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ab3b0682-ce31-4c6b-b225-f9f480995095 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1691 microversion: 2.1 time: 0.154424 Jul 14 10:19:36.511024 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 298/608] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:36 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:36.515308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:36.515900 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:36.521767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:36.522212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:36.522963 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:36.523394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:36.651273 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:36.659227 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b324ae00-19ff-4106-b122-746b39b08cdb tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.147286 Jul 14 10:19:36.659789 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 299/609] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:36 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:37.073965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-aae49867-2991-48e7-b927-63e84f128a26 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.037534 Jul 14 10:19:37.074615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 311/610] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:19:35 2022] POST /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments => generated 194 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:37.305143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-02950117-ef42-4f21-b2ad-b05b69e9ced1 req-3b5b5d8d-1550-4c8b-99ab-eee0dc83ca91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2418cd-d4dd-4a16-9d70-d601cb1efa76", "name": "network-vif-plugged", "status": "completed", "tag": "fd9be155-f5da-4d85-b353-8c3d7b3943c6"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:37.314462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-02950117-ef42-4f21-b2ad-b05b69e9ced1 req-3b5b5d8d-1550-4c8b-99ab-eee0dc83ca91 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:37.314970 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-02950117-ef42-4f21-b2ad-b05b69e9ced1 req-3b5b5d8d-1550-4c8b-99ab-eee0dc83ca91 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:37.326362 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-02950117-ef42-4f21-b2ad-b05b69e9ced1 req-3b5b5d8d-1550-4c8b-99ab-eee0dc83ca91 service nova] Creating event network-vif-plugged:fd9be155-f5da-4d85-b353-8c3d7b3943c6 for instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 on hv-cinder-84980 Jul 14 10:19:37.331783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-02950117-ef42-4f21-b2ad-b05b69e9ced1 req-3b5b5d8d-1550-4c8b-99ab-eee0dc83ca91 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106895 Jul 14 10:19:37.332684 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 300/611] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:37.528654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:37.529596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:37.537316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:37.537910 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:37.538842 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:37.539588 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:37.678413 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:37.679280 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:37.682421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:37.686221 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:37.686809 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:37.687669 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:37.688173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:37.691227 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9c19e800-1279-45d8-a914-a0558a8d365e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1691 microversion: 2.1 time: 0.167579 Jul 14 10:19:37.691800 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 312/612] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:37 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:37.709668 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:37.825678 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:37.833930 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-30f22e02-3dea-4abe-95ac-e0e0cebb3d5e tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.162029 Jul 14 10:19:37.834494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 301/613] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:37 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:38.295067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-31028131-33f2-47a2-ae00-142f5069fbbb req-1b75e866-89a6-4dab-a7e3-b1eddcf5030c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97b52dc3-0452-4872-b526-d4fce9ef4e93", "name": "network-vif-deleted", "tag": "b40b14ad-171e-4c6c-a909-36191cb0c933"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:38.304066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-31028131-33f2-47a2-ae00-142f5069fbbb req-1b75e866-89a6-4dab-a7e3-b1eddcf5030c service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:38.304518 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-31028131-33f2-47a2-ae00-142f5069fbbb req-1b75e866-89a6-4dab-a7e3-b1eddcf5030c service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:38.318645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-31028131-33f2-47a2-ae00-142f5069fbbb req-1b75e866-89a6-4dab-a7e3-b1eddcf5030c service nova] Creating event network-vif-deleted:b40b14ad-171e-4c6c-a909-36191cb0c933 for instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 on hv-cinder-84980 Jul 14 10:19:38.323518 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-31028131-33f2-47a2-ae00-142f5069fbbb req-1b75e866-89a6-4dab-a7e3-b1eddcf5030c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032147 Jul 14 10:19:38.324110 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 313/614] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:38.707478 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:38.708124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:38.710025 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=6 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:38.716069 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:38.716528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:38.717361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:38.718348 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:38.749840 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:38.750300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:38.750841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lazy-loading 'fault' on Instance uuid 97b52dc3-0452-4872-b526-d4fce9ef4e93 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:19:38.796816 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:38.804382 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3d556526-2e33-409c-ae2e-ec717bca864c tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 200 len: 1336 microversion: 2.1 time: 0.100749 Jul 14 10:19:38.806377 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 302/615] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:38 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:38.848127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:38.848995 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=6 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:38.853883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:38.860380 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:38.871058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:38.871058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:38.871890 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:38.872298 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:38.876612 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:39.019490 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:39.027610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2287b756-f2e9-485f-9e43-cd3830d08c73 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1363 microversion: 2.1 time: 0.180480 Jul 14 10:19:39.028177 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 314/616] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:38 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:39.822657 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:39.823267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 97b52dc3-0452-4872-b526-d4fce9ef4e93] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:39.829807 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:39.830264 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:39.831029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:39.831471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:39.844698 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] HTTP exception thrown: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 could not be found. Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Request method failure captured: Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 HTTP/1.1 Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmF_Dc5KK5U5RdOgCMFwTKCWRHcGY1SqAkKmXT9zqBHXLhW5Hy9gSLv7K34Pgdyv9-5xDIuGCEvIc-LU5hPPiY-CYtXCZHwT22mfzAVgT0-Lo9gKnjdYpdAPVBB2qeBWa_3tXTpi-vRR3BDRDONwkjsji7kPVoDokgsHaGocluCAk Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:19:39.846355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_76e4caaf5b9e49678bc6427b71560f19", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: ca339e26746a4feaaa25b14be59479a4 Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 could not be found. Jul 14 10:19:39.847860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '97b52dc3-0452-4872-b526-d4fce9ef4e93'} Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 could not be found. Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:19:39.848906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 could not be found. Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 could not be found. Jul 14 10:19:39.850311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:39.851528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Returning 404 to user: Instance 97b52dc3-0452-4872-b526-d4fce9ef4e93 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:19:39.851528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-aa719ae5-91ea-468c-8822-fa41b61525be tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93" status: 404 len: 111 microversion: 2.1 time: 0.029046 Jul 14 10:19:39.851528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 303/617] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:39 2022] GET /compute/v2.1/servers/97b52dc3-0452-4872-b526-d4fce9ef4e93 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:19:39.856174 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-dee1c9ac-6d1e-4636-b3de-8c9163fb04b0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '.version_select at 0x7f562587ee50>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:39.873354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-dee1c9ac-6d1e-4636-b3de-8c9163fb04b0 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863858242" status: 202 len: 0 microversion: 2.1 time: 0.020864 Jul 14 10:19:39.873937 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 315/618] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jul 14 10:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863858242 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:19:40.044883 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:40.045664 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:40.052455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:40.052905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:40.053913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:40.054352 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:40.284105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:40.294608 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-20727308-af0d-4350-ae5b-638a20187edf tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1549 microversion: 2.1 time: 0.253510 Jul 14 10:19:40.295179 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 304/619] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:40 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1549 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:40.311471 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:40.312038 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:40.318226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:40.318689 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:40.319466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:40.319907 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:40.420701 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e6a0ed99-c5e0-4315-9599-151600f5d495 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113145 Jul 14 10:19:40.426894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 316/620] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:19:40 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:41.587390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-39b57591-0c2a-4b31-8017-56d4cae88ac1 req-5b02f878-fe6b-4ed1-8b8c-717b4dbc1ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c2418cd-d4dd-4a16-9d70-d601cb1efa76", "tag": "fd9be155-f5da-4d85-b353-8c3d7b3943c6"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:41.596735 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-39b57591-0c2a-4b31-8017-56d4cae88ac1 req-5b02f878-fe6b-4ed1-8b8c-717b4dbc1ab3 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:41.597221 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-39b57591-0c2a-4b31-8017-56d4cae88ac1 req-5b02f878-fe6b-4ed1-8b8c-717b4dbc1ab3 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:41.610990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-39b57591-0c2a-4b31-8017-56d4cae88ac1 req-5b02f878-fe6b-4ed1-8b8c-717b4dbc1ab3 service nova] Creating event network-changed:fd9be155-f5da-4d85-b353-8c3d7b3943c6 for instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 on hv-cinder-84980 Jul 14 10:19:41.616083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-39b57591-0c2a-4b31-8017-56d4cae88ac1 req-5b02f878-fe6b-4ed1-8b8c-717b4dbc1ab3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032406 Jul 14 10:19:41.616686 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 305/621] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:42.823949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:42.824446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:42.830982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:42.831461 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:42.832221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:42.832664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:42.858797 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:19:42.929959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-845477a1-aaaf-4204-9d0f-f29929d8d402 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 204 len: 0 microversion: 2.1 time: 0.110023 Jul 14 10:19:42.930449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 317/622] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:19:42 2022] DELETE /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:19:42.940306 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:42.941223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:42.948374 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:42.949049 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:42.949966 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:42.950563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:43.082715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:43.090321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-86b0a136-64d4-4547-8fa0-cd9a276bedf7 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1509 microversion: 2.1 time: 0.155355 Jul 14 10:19:43.090884 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 306/623] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:42 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:44.110287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:44.110990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:44.117933 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:44.118387 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:44.119160 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:44.119597 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:44.253390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:44.261063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c866aad9-35b8-4495-a9ec-c3a3128d6b90 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1509 microversion: 2.1 time: 0.155646 Jul 14 10:19:44.261628 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 318/624] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:44 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:45.278478 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:45.279087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:45.286073 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.286521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.287287 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.287723 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.416587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:45.424781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3fb4c8fd-1489-4a80-bdc1-954f74c5f6a2 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 200 len: 1509 microversion: 2.1 time: 0.150083 Jul 14 10:19:45.425391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 307/625] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:45 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:45.543851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-39646ba7-9435-4466-9089-527a037cb77f req-f2b75400-3add-4e98-a72c-2625fd4e4739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1c8e49-223d-4c87-bb65-79edca0dac61", "name": "network-vif-deleted", "tag": "ae315f1e-83cb-48a2-a7c4-aec7aff8961d"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:45.554185 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-39646ba7-9435-4466-9089-527a037cb77f req-f2b75400-3add-4e98-a72c-2625fd4e4739 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.554662 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-39646ba7-9435-4466-9089-527a037cb77f req-f2b75400-3add-4e98-a72c-2625fd4e4739 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.566623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-39646ba7-9435-4466-9089-527a037cb77f req-f2b75400-3add-4e98-a72c-2625fd4e4739 service nova] Creating event network-vif-deleted:ae315f1e-83cb-48a2-a7c4-aec7aff8961d for instance dc1c8e49-223d-4c87-bb65-79edca0dac61 on hv-cinder-84980 Jul 14 10:19:45.572570 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-39646ba7-9435-4466-9089-527a037cb77f req-f2b75400-3add-4e98-a72c-2625fd4e4739 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032725 Jul 14 10:19:45.576834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 319/626] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:45.663938 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "171a3708-524c-4300-88ce-8621b140987a"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:45.665017 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:45.671540 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.672009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.672771 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.673221 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.751028 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Invalid volume: volume 171a3708-524c-4300-88ce-8621b140987a is already attached to instances: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: POST /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments HTTP/1.1 Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 74 Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:19:45.752810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {"volumeAttachment": {"volumeId": "171a3708-524c-4300-88ce-8621b140987a"}} Jul 14 10:19:45.754451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Invalid volume: volume 171a3708-524c-4300-88ce-8621b140987a is already attached to instances: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'server_id': '5e077b2f-2c84-41d9-9f6d-d8a4637b2fad', 'body': {'volumeAttachment': {'volumeId': '171a3708-524c-4300-88ce-8621b140987a'}}} Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 171a3708-524c-4300-88ce-8621b140987a is already attached to instances: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:45.755270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 171a3708-524c-4300-88ce-8621b140987a is already attached to instances: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:45.756444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 171a3708-524c-4300-88ce-8621b140987a is already attached to instances: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 400 to user: Invalid volume: volume 171a3708-524c-4300-88ce-8621b140987a is already attached to instances: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c97c4656-daac-4119-b862-141324279be7 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094403 Jul 14 10:19:45.757706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 308/627] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:19:45 2022] POST /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:19:45.816241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:45.816837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:45.823358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.823816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.824594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:45.825072 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:45.911536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'services' on Instance uuid 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:19:45.987401 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-70ac27eb-e0b6-4c7b-b8ce-019cf24186db tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments/171a3708-524c-4300-88ce-8621b140987a" status: 202 len: 0 microversion: 2.1 time: 0.175258 Jul 14 10:19:45.988026 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 320/628] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:19:45 2022] DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments/171a3708-524c-4300-88ce-8621b140987a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:19:45.996374 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:45.997403 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:46.003919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.004364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.005491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.006212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.041216 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ebda01db-a526-400a-a2fc-82fb70d1a643 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048678 Jul 14 10:19:46.041765 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 309/629] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:45 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:46.441522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:46.442235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: dc1c8e49-223d-4c87-bb65-79edca0dac61] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:46.448495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.448976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.449846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.450238 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.463991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] HTTP exception thrown: Instance dc1c8e49-223d-4c87-bb65-79edca0dac61 could not be found. Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Request method failure captured: Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 HTTP/1.1 Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmF_Dc5KK5U5RdOgCMFwTKCWRHcGY1SqAkKmXT9zqBHXLhW5Hy9gSLv7K34Pgdyv9-5xDIuGCEvIc-LU5hPPiY-CYtXCZHwT22mfzAVgT0-Lo9gKnjdYpdAPVBB2qeBWa_3tXTpi-vRR3BDRDONwkjsji7kPVoDokgsHaGocluCAk Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:19:46.465629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_76e4caaf5b9e49678bc6427b71560f19", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: ca339e26746a4feaaa25b14be59479a4 Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance dc1c8e49-223d-4c87-bb65-79edca0dac61 could not be found. Jul 14 10:19:46.467172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'dc1c8e49-223d-4c87-bb65-79edca0dac61'} Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1c8e49-223d-4c87-bb65-79edca0dac61 could not be found. Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:19:46.468688 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1c8e49-223d-4c87-bb65-79edca0dac61 could not be found. Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1c8e49-223d-4c87-bb65-79edca0dac61 could not be found. Jul 14 10:19:46.470543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:46.472108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Returning 404 to user: Instance dc1c8e49-223d-4c87-bb65-79edca0dac61 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:19:46.472108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1b4b9a10-78d4-4fac-b7d1-3665f4de7a18 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jul 14 10:19:46.472108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 321/630] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:46 2022] GET /compute/v2.1/servers/dc1c8e49-223d-4c87-bb65-79edca0dac61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:19:46.477332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:46.477837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:46.484793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.485349 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.486111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.486549 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.512862 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:19:46.587675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a686e9de-4722-4153-bfed-20312fda5103 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 204 len: 0 microversion: 2.1 time: 0.113831 Jul 14 10:19:46.591155 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 310/631] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:19:46 2022] DELETE /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:19:46.597907 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:46.598729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:46.605596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.606063 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.606845 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:46.607289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:46.737413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:46.744810 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f41dfed2-4700-4ab8-8915-292c4580888e tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.151831 Jul 14 10:19:46.745525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 322/632] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:46 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:47.054061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:47.055000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:47.061263 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:47.061722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:47.062502 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:47.062933 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:47.094218 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5dfdea75-c024-4c6c-a7f1-0126b7e496ce tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Jul 14 10:19:47.094759 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 311/633] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:47 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:47.762804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:47.763421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:47.770156 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:47.770611 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:47.771638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:47.772077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:47.902506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:47.910687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3fa8e3ac-5cd9-465e-8f89-00f3ef233bcd tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.151742 Jul 14 10:19:47.911253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 323/634] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:47 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:48.105591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:48.106518 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:48.113784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:48.114237 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:48.115006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:48.115463 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:48.145103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f89f973f-e482-4104-aefd-db04647ea479 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Jul 14 10:19:48.145662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 312/635] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:48 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:48.927516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:48.928140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:48.935568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:48.936028 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:48.936883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:48.937353 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.067152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:49.075127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-884e55e9-1e9b-4dec-a5ff-b6a9c03ac104 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1522 microversion: 2.1 time: 0.151552 Jul 14 10:19:49.075706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 324/636] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:48 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:49.159407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:49.160343 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:49.167091 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.167547 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.168355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.168863 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.203140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3b6d982c-5bb7-48ce-ae05-a739c981ead0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049754 Jul 14 10:19:49.203621 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 313/637] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:19:49 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:19:49.266416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:49.266941 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:49.273392 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.273841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.274603 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.275036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.300442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:19:49.379288 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-51cc0729-7467-4d43-976e-49f66748c89b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 204 len: 0 microversion: 2.1 time: 0.115762 Jul 14 10:19:49.381005 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 325/638] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:19:49 2022] DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:19:49.388826 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:49.389467 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:49.396600 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.397177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.397961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.398411 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.531871 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:49.540085 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a1f09b70-43b7-42f6-b90f-b0aec1567d66 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1682 microversion: 2.1 time: 0.156111 Jul 14 10:19:49.540778 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 314/639] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:49 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:19:49.765851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-19fee9cb-d3ca-4b12-99c1-c3a0008a290f req-9525c00a-ad70-4738-a788-e5906f09b542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afff4cc-eaa2-4da3-8511-45d0b306c539", "name": "network-vif-deleted", "tag": "92d02821-6f9a-4eb7-b48c-24008feeb3ed"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:49.774084 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-19fee9cb-d3ca-4b12-99c1-c3a0008a290f req-9525c00a-ad70-4738-a788-e5906f09b542 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:49.774517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-19fee9cb-d3ca-4b12-99c1-c3a0008a290f req-9525c00a-ad70-4738-a788-e5906f09b542 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:49.785843 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-19fee9cb-d3ca-4b12-99c1-c3a0008a290f req-9525c00a-ad70-4738-a788-e5906f09b542 service nova] Creating event network-vif-deleted:92d02821-6f9a-4eb7-b48c-24008feeb3ed for instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 on hv-cinder-84980 Jul 14 10:19:49.790501 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-19fee9cb-d3ca-4b12-99c1-c3a0008a290f req-9525c00a-ad70-4738-a788-e5906f09b542 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028757 Jul 14 10:19:49.791074 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 326/640] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:50.094033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:50.094673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:50.101093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:50.101555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:50.102567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:50.102771 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:50.167021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:50.175407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f07195bd-5bcf-4528-b36d-b680ffca8c8f tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1480 microversion: 2.1 time: 0.085996 Jul 14 10:19:50.175981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 315/641] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:50 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1480 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:50.558842 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:50.559546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:50.562622 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:50.566893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:50.567355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:50.568121 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:50.568565 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:50.703432 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:50.710951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-79bab988-0d34-4581-846f-683f5f7b18f0 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1682 microversion: 2.1 time: 0.156837 Jul 14 10:19:50.711511 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 327/642] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:50 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:51.191789 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:51.192404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:51.194809 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:51.200082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:51.200535 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:51.201340 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:51.201782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:51.235182 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:51.235631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:51.236086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lazy-loading 'fault' on Instance uuid 0afff4cc-eaa2-4da3-8511-45d0b306c539 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:19:51.280950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca339e26746a4feaaa25b14be59479a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e4caaf5b9e49678bc6427b71560f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:51.288402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f921a3f0-343f-4d37-a39e-ba4cdd94aa76 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 200 len: 1311 microversion: 2.1 time: 0.100452 Jul 14 10:19:51.289014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 316/643] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:51 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:51.727494 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:51.728139 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:51.734808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:51.735254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:51.736011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:51.736445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:51.867404 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:51.875992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ffea3fc5-cf0b-4ea0-83cd-293eec61fe68 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 200 len: 1682 microversion: 2.1 time: 0.152280 Jul 14 10:19:51.876561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 328/644] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:51 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:52.247097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-13ed1d15-86b0-4cfb-b9e8-bbd4bcd9def1 req-417d58b3-d1ef-44e0-b4cf-3a81e9ff4555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e077b2f-2c84-41d9-9f6d-d8a4637b2fad", "name": "network-vif-deleted", "tag": "5176281a-87a4-47dd-9b90-45bcffacb063"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:52.256852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-13ed1d15-86b0-4cfb-b9e8-bbd4bcd9def1 req-417d58b3-d1ef-44e0-b4cf-3a81e9ff4555 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:52.257509 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-13ed1d15-86b0-4cfb-b9e8-bbd4bcd9def1 req-417d58b3-d1ef-44e0-b4cf-3a81e9ff4555 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:52.261886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:52.271784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-13ed1d15-86b0-4cfb-b9e8-bbd4bcd9def1 req-417d58b3-d1ef-44e0-b4cf-3a81e9ff4555 service nova] Creating event network-vif-deleted:5176281a-87a4-47dd-9b90-45bcffacb063 for instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad on hv-cinder-84980 Jul 14 10:19:52.277247 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-13ed1d15-86b0-4cfb-b9e8-bbd4bcd9def1 req-417d58b3-d1ef-44e0-b4cf-3a81e9ff4555 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033855 Jul 14 10:19:52.278032 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 317/645] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:52.305918 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:52.306542 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] [instance: 0afff4cc-eaa2-4da3-8511-45d0b306c539] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:52.313457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:52.314153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:52.314939 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:52.315386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:52.332312 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] HTTP exception thrown: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 could not be found. Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Request method failure captured: Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 HTTP/1.1 Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmF_Dc5KK5U5RdOgCMFwTKCWRHcGY1SqAkKmXT9zqBHXLhW5Hy9gSLv7K34Pgdyv9-5xDIuGCEvIc-LU5hPPiY-CYtXCZHwT22mfzAVgT0-Lo9gKnjdYpdAPVBB2qeBWa_3tXTpi-vRR3BDRDONwkjsji7kPVoDokgsHaGocluCAk Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:19:52.334395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_76e4caaf5b9e49678bc6427b71560f19", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/76e4caaf5b9e49678bc6427b71560f19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 76e4caaf5b9e49678bc6427b71560f19 Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1453365297 Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: ca339e26746a4feaaa25b14be59479a4 Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1453365297-project Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 could not be found. Jul 14 10:19:52.336368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '0afff4cc-eaa2-4da3-8511-45d0b306c539'} Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 could not be found. Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:19:52.337291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 could not be found. Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 could not be found. Jul 14 10:19:52.338763 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.341151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] Returning 404 to user: Instance 0afff4cc-eaa2-4da3-8511-45d0b306c539 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:19:52.342259 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4c966d47-e181-440a-a432-c12032f210e6 tempest-ServerRescueNegativeTestJSON-1453365297 tempest-ServerRescueNegativeTestJSON-1453365297-project] 10.222.0.61 "GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539" status: 404 len: 111 microversion: 2.1 time: 0.040361 Jul 14 10:19:52.343069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 329/646] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:52 2022] GET /compute/v2.1/servers/0afff4cc-eaa2-4da3-8511-45d0b306c539 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:19:52.895828 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:52.896792 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:52.903617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:52.904062 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:52.904836 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:52.906041 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:52.921334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad HTTP/1.1 Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:19:52.923000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:19:52.924300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '5e077b2f-2c84-41d9-9f6d-d8a4637b2fad'} Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:19:52.925083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:19:52.926293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:19:52.927388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:19:52.927388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-196b9033-3941-4674-932f-2008fc1579ae tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 404 len: 111 microversion: 2.1 time: 0.034730 Jul 14 10:19:52.927388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 318/647] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:52 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:19:52.933519 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-547ae99a-1ff4-45d6-8cbd-3cfc305ec601 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '.version_select at 0x7f56258d18b0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:52.953526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-547ae99a-1ff4-45d6-8cbd-3cfc305ec601 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763612660" status: 202 len: 0 microversion: 2.1 time: 0.023812 Jul 14 10:19:52.954124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 330/648] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jul 14 10:19:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1763612660 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:19:53.972336 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ad66fed0-77a6-49c8-865f-0d521f014773 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: .version_select at 0x7f562587a8b0>, body: {"keypair": {"name": "tempest-keypair-1531765549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEngZCzxewPNKgMsMfNB4mwan1CgnLyMNjrdjsIKXWmUdSQY9vuwp7oy9T0QU3zHkxo6GisRky6xg7+df2gM/447bbs2qHva6bIqXsIy1/cGEBbxFRNt8RQAU05mU20znA=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:53.986814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-ad66fed0-77a6-49c8-865f-0d521f014773 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:19:53.992759 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-ad66fed0-77a6-49c8-865f-0d521f014773 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:19:54.018406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ad66fed0-77a6-49c8-865f-0d521f014773 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050448 Jul 14 10:19:54.019616 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 319/649] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:19:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:19:56.103125 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1733776087", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f"}], "security_groups": [{"name": "tempest-securitygroup--2053577006"}], "key_name": "tempest-keypair-1531765549", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:56.238664 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] validate_networks() for [('2ee5f5e1-d63c-4e86-b537-e2fb50d5ce4f', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:19:56.632266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:19:56.632789 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:19:56.633392 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:19:56.634044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:19:56.634562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:19:56.644818 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:56.645533 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:56.646656 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:56.647138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:56.668241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:19:56.674334 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Getting quotas for user bff5f2d1367545f2b4c77fe0d9f095ab and project 5056f0a32e37430ea3ea63d9cb69bf2b. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:19:56.691243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:19:56.693979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:19:56.741681 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a7656f5d-a163-4f8d-8b67-3fcd30a1a1bc tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.644685 Jul 14 10:19:56.742633 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 331/650] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:19:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:19:56.753018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a223368b-af6d-49a8-bc2c-7aac13dcf772 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:56.753634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a223368b-af6d-49a8-bc2c-7aac13dcf772 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:56.857278 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a223368b-af6d-49a8-bc2c-7aac13dcf772 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:56.867307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a223368b-af6d-49a8-bc2c-7aac13dcf772 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1242 microversion: 2.1 time: 0.117024 Jul 14 10:19:56.878983 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 320/651] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:56 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:57.886518 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:57.887745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:57.899850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:57.900521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:57.901316 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:57.901754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:57.920129 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:19:57.966280 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:57.974876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-793b132a-18c7-42d7-9cdf-8717850ad456 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1300 microversion: 2.1 time: 0.093093 Jul 14 10:19:57.983268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 332/652] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:57 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:58.993772 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:19:58.995325 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:19:59.005866 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:59.006593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:59.008457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:59.009131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:59.305740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:19:59.318546 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6153a4a5-f2eb-443d-80a7-1e433a7c4292 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.330524 Jul 14 10:19:59.329485 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 321/653] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:19:58 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:19:59.535740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-ef6e4cb9-2dcd-444a-a9e3-2a3407d65b2e req-a1f9e360-1d67-42d5-918b-38c592978d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7411091-94a7-46f4-8e0f-43581972d772", "tag": "2a830823-d4db-40c7-8cf3-b5e63383422a"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:19:59.577938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-ef6e4cb9-2dcd-444a-a9e3-2a3407d65b2e req-a1f9e360-1d67-42d5-918b-38c592978d4d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:19:59.579420 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-ef6e4cb9-2dcd-444a-a9e3-2a3407d65b2e req-a1f9e360-1d67-42d5-918b-38c592978d4d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:19:59.621031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-ef6e4cb9-2dcd-444a-a9e3-2a3407d65b2e req-a1f9e360-1d67-42d5-918b-38c592978d4d service nova] Creating event network-changed:2a830823-d4db-40c7-8cf3-b5e63383422a for instance f7411091-94a7-46f4-8e0f-43581972d772 on hv-cinder-84980 Jul 14 10:19:59.635180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-ef6e4cb9-2dcd-444a-a9e3-2a3407d65b2e req-a1f9e360-1d67-42d5-918b-38c592978d4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104226 Jul 14 10:19:59.636246 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 333/654] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:00.335372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:00.336151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:00.343460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:00.343912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:00.344692 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:00.345166 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:00.589413 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:00.597722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ef37331b-4b18-43e4-8164-7d70c94b9be5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.266152 Jul 14 10:20:00.598301 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 322/655] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:00 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:01.617355 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:01.618846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:01.634470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:01.635261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:01.638427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:01.639714 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:01.866748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:01.878376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f3b139e8-4f2e-4211-8719-f9a1fa5dfda5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.266344 Jul 14 10:20:01.879257 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 334/656] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:01 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:02.897404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:02.898113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:02.914089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:02.917195 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:02.918475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:02.924412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:03.087014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:03.095744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-80ee999b-3176-4b38-95ac-085edeb9e2c5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.202792 Jul 14 10:20:03.096643 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 323/657] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:02 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:03.147650 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ddaa6581-d7d2-48eb-990e-78eb0963c9d8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'create', calling method: .version_select at 0x7f5625a03af0>, body: {"keypair": {"name": "tempest-keypair-670224282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzmkJKRVQEuNVxkTUJ/ElV2YPNCYgJpLxX/PmvIx3ImHdrc/NWdApaR7sniA6732fNLGPy3LjPvnVkOjcrCGGrQLcOh/EwYQ8JdoH2W67vHVhaN3MTfN2h0Mn1COVmpKQ=="}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:03.163300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-ddaa6581-d7d2-48eb-990e-78eb0963c9d8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for project 4f945783031448849dc0e5a3337f8c76. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:20:03.167416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-ddaa6581-d7d2-48eb-990e-78eb0963c9d8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for user 7b0f433eba57485cbbfeab651a8e8b02 and project 4f945783031448849dc0e5a3337f8c76. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:20:03.196906 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ddaa6581-d7d2-48eb-990e-78eb0963c9d8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.191761 Jul 14 10:20:03.197824 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 335/658] 10.222.0.61 () {62 vars in 1199 bytes} [Thu Jul 14 10:20:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 10:20:04.113267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:04.114027 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:04.123805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:04.124034 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:04.125095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:04.125659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:04.360625 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:04.374575 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9e1116e0-b4de-4833-bc38-579132b76ff2 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.265609 Jul 14 10:20:04.375513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 324/659] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:04 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:04.615999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-346585091", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b0d2893-bd16-48bf-a613-0a94b5150967"}], "security_groups": [{"name": "tempest-securitygroup--1839668877"}], "key_name": "tempest-keypair-670224282", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:04.727504 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] validate_networks() for [('9b0d2893-bd16-48bf-a613-0a94b5150967', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:20:05.125361 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:20:05.125817 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:20:05.126319 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:20:05.126731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:20:05.127168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:20:05.136168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.136845 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.137687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.138129 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.157037 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for project 4f945783031448849dc0e5a3337f8c76. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:20:05.161831 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for user 7b0f433eba57485cbbfeab651a8e8b02 and project 4f945783031448849dc0e5a3337f8c76. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:20:05.176255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:20:05.178746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:20:05.236094 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a9cf54a2-d103-4fb9-8da3-73976ed881e0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.625105 Jul 14 10:20:05.236750 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 336/660] 10.222.0.61 () {62 vars in 1187 bytes} [Thu Jul 14 10:20:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 10:20:05.254109 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a333bc5b-98d4-4aee-9dd5-84ebdfc3fec4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:05.254745 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a333bc5b-98d4-4aee-9dd5-84ebdfc3fec4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:05.337538 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a333bc5b-98d4-4aee-9dd5-84ebdfc3fec4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:05.346876 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a333bc5b-98d4-4aee-9dd5-84ebdfc3fec4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:05.348628 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a333bc5b-98d4-4aee-9dd5-84ebdfc3fec4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:05.350472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a333bc5b-98d4-4aee-9dd5-84ebdfc3fec4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1280 microversion: 2.20 time: 0.106027 Jul 14 10:20:05.362086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 325/661] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:05 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:05.391971 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:05.392614 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:05.399767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.400717 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.401765 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.402858 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.424678 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-da6669d5-3f6a-429a-aed0-50b859b63ab0 req-9535a8f7-5be7-4710-9e0e-0c6491adae7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7411091-94a7-46f4-8e0f-43581972d772", "name": "network-vif-plugged", "status": "completed", "tag": "2a830823-d4db-40c7-8cf3-b5e63383422a"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:05.443042 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-da6669d5-3f6a-429a-aed0-50b859b63ab0 req-9535a8f7-5be7-4710-9e0e-0c6491adae7b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:05.443503 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-da6669d5-3f6a-429a-aed0-50b859b63ab0 req-9535a8f7-5be7-4710-9e0e-0c6491adae7b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:05.472364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-da6669d5-3f6a-429a-aed0-50b859b63ab0 req-9535a8f7-5be7-4710-9e0e-0c6491adae7b service nova] Creating event network-vif-plugged:2a830823-d4db-40c7-8cf3-b5e63383422a for instance f7411091-94a7-46f4-8e0f-43581972d772 on hv-cinder-84980 Jul 14 10:20:05.485711 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-da6669d5-3f6a-429a-aed0-50b859b63ab0 req-9535a8f7-5be7-4710-9e0e-0c6491adae7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067142 Jul 14 10:20:05.494588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 326/662] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:05.636693 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:05.647101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ac5ced0f-b4cf-4fa5-a19b-1d3762e7311a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.259300 Jul 14 10:20:05.647620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 337/663] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:05 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:06.371397 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:06.372058 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:06.380062 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:06.380814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:06.385550 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:06.386368 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:06.457243 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:06.465614 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:06.467162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:06.468302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d23ff3e8-49f6-451a-a097-95a78741a030 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1332 microversion: 2.20 time: 0.101676 Jul 14 10:20:06.468856 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 327/664] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:06 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:06.663986 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:06.664644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:06.671953 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:06.672409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:06.673202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:06.673638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:06.812475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:06.820290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-49f12c1f-6be6-49dd-8e97-edf98a84ae5b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1368 microversion: 2.1 time: 0.160343 Jul 14 10:20:06.820869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 338/665] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:06 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:07.488140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:07.488767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:07.495721 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:07.496152 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:07.496919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:07.497379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:07.565628 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:07.575178 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:07.577592 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:07.579095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7ff26fcd-70dd-4fcf-8f39-a2f80bc368a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1340 microversion: 2.20 time: 0.095048 Jul 14 10:20:07.579821 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 328/666] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:07 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:07.836509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:07.837208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:07.844056 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:07.844498 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:07.845281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:07.845711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:07.977370 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:07.985634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4f000184-8543-48aa-b5cc-5fa449c0c3f6 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1557 microversion: 2.1 time: 0.152839 Jul 14 10:20:07.996449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 339/667] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:07 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:08.001772 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:08.002381 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:08.008555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:08.009055 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:08.009830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:08.010274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:08.088996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-75a631df-8649-4d4b-b30f-ab7289013483 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090999 Jul 14 10:20:08.089905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 329/668] 10.222.0.61 () {58 vars in 1274 bytes} [Thu Jul 14 10:20:07 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:08.598189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:08.599153 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:08.605985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:08.606787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:08.608272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:08.608957 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:08.952584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-ab0eb10d-2106-45f4-8d45-60a4e663b2eb req-c4ed6fa6-d470-4486-9493-c75189a7cfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:08.961422 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-ab0eb10d-2106-45f4-8d45-60a4e663b2eb req-c4ed6fa6-d470-4486-9493-c75189a7cfd5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:08.962126 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-ab0eb10d-2106-45f4-8d45-60a4e663b2eb req-c4ed6fa6-d470-4486-9493-c75189a7cfd5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:08.976406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-ab0eb10d-2106-45f4-8d45-60a4e663b2eb req-c4ed6fa6-d470-4486-9493-c75189a7cfd5 service nova] Creating event network-changed:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:20:08.983103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-ab0eb10d-2106-45f4-8d45-60a4e663b2eb req-c4ed6fa6-d470-4486-9493-c75189a7cfd5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033046 Jul 14 10:20:08.984613 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 330/669] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:08.988506 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:09.000838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:09.002650 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:09.005125 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a78d2fa2-393e-4402-a3b6-651dc29dc505 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1406 microversion: 2.20 time: 0.410633 Jul 14 10:20:09.008598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 340/670] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:08 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:09.528662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-7f943eef-200d-4d94-ac71-e75508f155ee req-cffcb202-1634-4373-bb34-c7467fbb2a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7411091-94a7-46f4-8e0f-43581972d772", "tag": "2a830823-d4db-40c7-8cf3-b5e63383422a"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:09.537559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-7f943eef-200d-4d94-ac71-e75508f155ee req-cffcb202-1634-4373-bb34-c7467fbb2a1b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:09.538005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-7f943eef-200d-4d94-ac71-e75508f155ee req-cffcb202-1634-4373-bb34-c7467fbb2a1b service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:09.549349 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-7f943eef-200d-4d94-ac71-e75508f155ee req-cffcb202-1634-4373-bb34-c7467fbb2a1b service nova] Creating event network-changed:2a830823-d4db-40c7-8cf3-b5e63383422a for instance f7411091-94a7-46f4-8e0f-43581972d772 on hv-cinder-84980 Jul 14 10:20:09.554232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-7f943eef-200d-4d94-ac71-e75508f155ee req-cffcb202-1634-4373-bb34-c7467fbb2a1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089893 Jul 14 10:20:09.554839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 331/671] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:10.023869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:10.024389 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:10.031517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:10.031974 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:10.032760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:10.033233 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:10.167994 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:10.176294 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:10.177847 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:10.178956 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e08220ca-9f7c-405e-b510-aad2646c51b9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1406 microversion: 2.20 time: 0.159357 Jul 14 10:20:10.179507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 341/672] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:10 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:11.198345 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:11.199045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:11.205724 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:11.206174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:11.206962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:11.207384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:11.337621 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:11.346819 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:11.348523 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:11.349886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2fbef6bc-5da4-43e5-af50-fe52474d5118 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1406 microversion: 2.20 time: 0.156405 Jul 14 10:20:11.350530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 332/673] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:11 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:20:12.368039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:12.368563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:12.375741 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:12.376196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:12.376991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:12.377436 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:12.519057 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:12.527225 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:12.528753 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:12.530441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-591607e7-92c0-4ab3-9805-44048f5940a4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1406 microversion: 2.20 time: 0.166382 Jul 14 10:20:12.531007 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 342/674] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:12 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:13.402951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-0de51ecd-ace9-4e49-9b9b-cc83fa5487f5 req-67a666c9-4260-441f-a706-8d8faabd2445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "name": "network-vif-plugged", "status": "completed", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:13.412163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-0de51ecd-ace9-4e49-9b9b-cc83fa5487f5 req-67a666c9-4260-441f-a706-8d8faabd2445 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.412607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-0de51ecd-ace9-4e49-9b9b-cc83fa5487f5 req-67a666c9-4260-441f-a706-8d8faabd2445 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.427382 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-0de51ecd-ace9-4e49-9b9b-cc83fa5487f5 req-67a666c9-4260-441f-a706-8d8faabd2445 service nova] Creating event network-vif-plugged:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:20:13.432466 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-0de51ecd-ace9-4e49-9b9b-cc83fa5487f5 req-67a666c9-4260-441f-a706-8d8faabd2445 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Jul 14 10:20:13.433518 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 333/675] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:13.548175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:13.548777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:13.555444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.555902 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.556705 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:13.557178 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:13.686525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:13.694413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:13.695981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:13.697101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d42ca98a-f3a6-4f9d-b335-005aad4ef2ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1406 microversion: 2.20 time: 0.152944 Jul 14 10:20:13.697693 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 343/676] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:13 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:14.717134 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:14.717827 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:14.724060 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:14.724515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:14.725318 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:14.725752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:14.856648 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:14.865385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:14.866904 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:14.868003 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5dc06cd2-71c0-452c-8808-9fb6ff9b7279 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1406 microversion: 2.20 time: 0.156131 Jul 14 10:20:14.868555 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 334/677] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:14 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:15.886003 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:15.886635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:15.889698 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:15.890553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=16 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:15.896799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.897282 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:15.898058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:15.898502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:16.029513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:16.037508 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:16.039071 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:16.040229 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-33dc0844-277a-4882-937f-6456ad8d3c82 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1598 microversion: 2.20 time: 0.158144 Jul 14 10:20:16.040784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 344/678] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:20:15 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:20:16.058009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:16.058536 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:16.061184 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=8 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:16.067749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:16.068201 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:16.068999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:16.069438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:16.146355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-24c87d48-588d-41e0-88c7-293103fb0cae tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092147 Jul 14 10:20:16.146946 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 335/679] 10.222.0.61 () {60 vars in 1315 bytes} [Thu Jul 14 10:20:16 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:20:17.059932 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-0d357873-8ba2-48bc-a018-30782eb6aba3 req-89c1ef11-b3c0-4a5d-83fb-fabe3d492d5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:17.068548 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-0d357873-8ba2-48bc-a018-30782eb6aba3 req-89c1ef11-b3c0-4a5d-83fb-fabe3d492d5d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:17.069052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-0d357873-8ba2-48bc-a018-30782eb6aba3 req-89c1ef11-b3c0-4a5d-83fb-fabe3d492d5d service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:17.080394 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-0d357873-8ba2-48bc-a018-30782eb6aba3 req-89c1ef11-b3c0-4a5d-83fb-fabe3d492d5d service nova] Creating event network-changed:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:20:17.085409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-0d357873-8ba2-48bc-a018-30782eb6aba3 req-89c1ef11-b3c0-4a5d-83fb-fabe3d492d5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029083 Jul 14 10:20:17.086914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 345/680] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:22.121210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:22.121717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:22.124143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:22.130108 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.130565 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.131331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.131774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.163196 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:20:22.241117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cf0ace6a-638d-45f1-bdbe-4f53a7709775 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 204 len: 0 microversion: 2.1 time: 0.123957 Jul 14 10:20:22.242012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 336/681] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:22 2022] DELETE /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:20:22.251757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:22.252455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:22.254407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:22.261046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.261503 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.262276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:22.262717 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:22.393981 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:22.401752 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-32a099f4-ec04-48b9-a811-dee3eaae77e2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1577 microversion: 2.1 time: 0.154922 Jul 14 10:20:22.402318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 346/682] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:22 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:23.420161 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:23.420858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:23.427404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.427856 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.428619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:23.429099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:23.431695 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:23.565399 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:23.572845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d7f6a223-be6f-41b1-a91c-69a60c621585 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1577 microversion: 2.1 time: 0.156946 Jul 14 10:20:23.573448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 337/683] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:23 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:24.592027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:24.592915 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:24.599994 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.600540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:24.601394 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.601795 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:24.745469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:24.753886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b1aefe01-348e-4e9a-894a-efa3a753e4a0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 200 len: 1577 microversion: 2.1 time: 0.166602 Jul 14 10:20:24.754459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 347/684] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:24 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:24.985819 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-479b055e-2ff0-47ba-b055-f5e0218b25aa req-19f01ab8-44a9-4726-bcfd-60e5ccc88944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce402fd6-a9d2-4651-9e76-aa616b99b208", "name": "network-vif-deleted", "tag": "4b9960d1-29f9-466d-84b3-07562c942f9c"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:24.994517 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-479b055e-2ff0-47ba-b055-f5e0218b25aa req-19f01ab8-44a9-4726-bcfd-60e5ccc88944 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:24.994962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-479b055e-2ff0-47ba-b055-f5e0218b25aa req-19f01ab8-44a9-4726-bcfd-60e5ccc88944 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:25.009271 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-479b055e-2ff0-47ba-b055-f5e0218b25aa req-19f01ab8-44a9-4726-bcfd-60e5ccc88944 service nova] Creating event network-vif-deleted:4b9960d1-29f9-466d-84b3-07562c942f9c for instance ce402fd6-a9d2-4651-9e76-aa616b99b208 on hv-cinder-84980 Jul 14 10:20:25.014559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-479b055e-2ff0-47ba-b055-f5e0218b25aa req-19f01ab8-44a9-4726-bcfd-60e5ccc88944 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032498 Jul 14 10:20:25.015477 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 338/685] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:25.237252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:25.237888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:25.256210 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:25.261396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:25.262227 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:25.262681 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:25.287593 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3c558400-2799-4966-a0c3-e69bf0741231 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/ips" status: 200 len: 146 microversion: 2.1 time: 0.055519 Jul 14 10:20:25.293620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 348/686] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:20:25 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:25.773475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:25.774167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:25.781315 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:25.781764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:25.782541 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:25.783170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:25.799663 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] HTTP exception thrown: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Request method failure captured: Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 HTTP/1.1 Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-0jn51-_eUptSQxR76i7Zj658zZJiBdOryHkDUxXJrusEra9J5v8Vst9BzNvW2RKyJ1PWfjF1xZrb51o1DMQnAfpR7XMMhd9djovqpUe_YP408gUT_J8MDsn8JBks7yZKtpJlCatqaso8Op2iNMzXajtrbLwhdf-6eEiGjwD4fobCU Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:20:25.801805 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f5484157d3894ec097d1f1b2e0bacc16", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-TestVolumeBootPattern-951692695 Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 8cd8f0490c6949cbba431b0b317683fd Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:20:25.803552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'ce402fd6-a9d2-4651-9e76-aa616b99b208'} Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:25.804749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:20:25.806370 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:25.807775 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Returning 404 to user: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:25.807775 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-32c9c105-beba-4e46-8b58-100fb2579a39 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 404 len: 111 microversion: 2.1 time: 0.035197 Jul 14 10:20:25.811369 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 339/687] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:25 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:25.907706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-881550841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2142394265", "security_groups": [{"name": "tempest-secgroup-smoke-957205412"}], "block_device_mapping_v2": [{"uuid": "fe84980a-4b51-4bbd-99d8-f83f89b27379", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a5bd4dd-229b-4523-a623-35c0c9078f3c"}]}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:26.022106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] validate_networks() for [('6a5bd4dd-229b-4523-a623-35c0c9078f3c', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:20:26.383521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:20:26.383945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:20:26.384424 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:20:26.384834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:20:26.385271 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:20:26.394690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:26.395403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:26.396195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:26.396634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:26.413596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:20:26.417529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for user 8cd8f0490c6949cbba431b0b317683fd and project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:20:26.474110 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:20:26.476202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe84980a-4b51-4bbd-99d8-f83f89b27379',volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:20:26.603933 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b847f31c-9095-4112-8438-a0c0814f62c7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.700197 Jul 14 10:20:26.609784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 349/688] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:20:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:20:26.615630 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c1cecc8d-e724-476c-ab9e-be900fa0905e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:26.616266 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c1cecc8d-e724-476c-ab9e-be900fa0905e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:26.629803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91f3ce86-1d0e-47c4-82b0-e97558847a61"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:26.631012 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:26.637163 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:26.637616 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:26.639005 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:26.639628 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:26.689382 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c1cecc8d-e724-476c-ab9e-be900fa0905e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:26.697643 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c1cecc8d-e724-476c-ab9e-be900fa0905e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1094 microversion: 2.1 time: 0.086061 Jul 14 10:20:26.699475 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 340/689] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:26 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:26.885668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-17c29958-f6a5-4330-9254-4bb3328c85ec tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259744 Jul 14 10:20:26.886299 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 350/690] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:20:26 2022] POST /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:27.714917 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:27.715517 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:27.723601 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:27.724051 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:27.724815 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:27.726063 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:27.786387 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:27.793700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-24145cd9-d68f-48a2-acbf-52f41912f792 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1210 microversion: 2.1 time: 0.082845 Jul 14 10:20:27.794840 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 341/691] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:27 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:28.812204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:28.813121 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:28.819133 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:28.819592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:28.820366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:28.820811 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:28.825192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:28.973405 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:28.981929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d18b7c29-0e59-4512-b17a-9018b1f9eb9d tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1277 microversion: 2.1 time: 0.174448 Jul 14 10:20:28.984243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 351/692] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:28 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:29.156994 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-e6fd4fba-51b4-402d-be51-9a5bd0dddacf req-cc3c10ee-bdd1-440e-a3fd-452e830b7329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0878a889-2692-4dab-8be3-52a648470261", "tag": "843c538b-92d0-432e-89e7-4dcf474bc2e2"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:29.166100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-e6fd4fba-51b4-402d-be51-9a5bd0dddacf req-cc3c10ee-bdd1-440e-a3fd-452e830b7329 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:29.166677 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-e6fd4fba-51b4-402d-be51-9a5bd0dddacf req-cc3c10ee-bdd1-440e-a3fd-452e830b7329 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:29.179810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-e6fd4fba-51b4-402d-be51-9a5bd0dddacf req-cc3c10ee-bdd1-440e-a3fd-452e830b7329 service nova] Creating event network-changed:843c538b-92d0-432e-89e7-4dcf474bc2e2 for instance 0878a889-2692-4dab-8be3-52a648470261 on hv-cinder-84980 Jul 14 10:20:29.185609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-e6fd4fba-51b4-402d-be51-9a5bd0dddacf req-cc3c10ee-bdd1-440e-a3fd-452e830b7329 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032071 Jul 14 10:20:29.186269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 342/693] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:30.000252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:30.000863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:30.007217 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:30.007665 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:30.008422 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:30.008852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:30.150572 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:30.158237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-bad0ccb9-4427-4667-9843-27edb27b54b7 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1277 microversion: 2.1 time: 0.162466 Jul 14 10:20:30.158803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 352/694] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:29 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:31.176151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:31.176853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:31.183515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:31.183976 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:31.184758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:31.185230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:31.317687 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:31.325170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6b0628eb-f5e7-4d84-943d-156ab3ca0eee tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1277 microversion: 2.1 time: 0.153562 Jul 14 10:20:31.325727 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 343/695] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:31 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:32.341954 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:32.342567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:32.348806 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:32.349286 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:32.350055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:32.350494 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:32.789428 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:32.797451 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c81d6554-d2ee-4407-8e85-d340ca698f4e tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1277 microversion: 2.1 time: 0.459473 Jul 14 10:20:32.798032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 353/696] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:32 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:33.254147 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:33.257159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-4109d154-8d29-47fe-97e9-fe45aae826fc req-b6a3dcc4-9e27-4780-b83f-8ddcf44e6f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:33.260972 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:33.271904 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.272341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.273157 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.275528 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-4109d154-8d29-47fe-97e9-fe45aae826fc req-b6a3dcc4-9e27-4780-b83f-8ddcf44e6f37 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.276157 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-4109d154-8d29-47fe-97e9-fe45aae826fc req-b6a3dcc4-9e27-4780-b83f-8ddcf44e6f37 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.280633 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.301666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-4109d154-8d29-47fe-97e9-fe45aae826fc req-b6a3dcc4-9e27-4780-b83f-8ddcf44e6f37 service nova] Creating event network-changed:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:20:33.312511 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-4109d154-8d29-47fe-97e9-fe45aae826fc req-b6a3dcc4-9e27-4780-b83f-8ddcf44e6f37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068892 Jul 14 10:20:33.313865 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 354/697] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:33.327380 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:20:33.433367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8dde0a79-171f-4382-acc7-dcdc27f06b8f tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "DELETE /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 204 len: 0 microversion: 2.1 time: 0.182348 Jul 14 10:20:33.436099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 344/698] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:33 2022] DELETE /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:20:33.447990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:33.451231 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:33.459244 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.460170 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.461361 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.462071 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.616232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:33.626475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-29ba6558-b599-4ca6-b6ac-617fc242f70c tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.185884 Jul 14 10:20:33.627052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 355/699] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:33 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:33.814990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:33.815675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:33.821794 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.822221 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.822996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:33.823453 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:33.956208 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:33.963841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4db29a68-f0f9-481c-88f8-941115dd7724 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1277 microversion: 2.1 time: 0.153243 Jul 14 10:20:33.964423 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 345/700] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:33 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:34.410448 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:34.411423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:34.417406 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.417853 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.419119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.419552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.448068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ca44d6e6-618f-4310-b8dd-3292f2893f69 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Jul 14 10:20:34.448675 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 356/701] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:34 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:34.458391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:34.458860 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:34.465275 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.465803 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.466568 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.467008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.497606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9017fd3b-1f2f-496e-b869-175955ffeb6d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/91f3ce86-1d0e-47c4-82b0-e97558847a61" status: 200 len: 194 microversion: 2.1 time: 0.042469 Jul 14 10:20:34.498182 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 346/702] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Jul 14 10:20:34 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/91f3ce86-1d0e-47c4-82b0-e97558847a61 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:34.645236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:34.646045 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:34.652595 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.653795 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.654576 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.655016 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.810583 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:34.819651 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ce4db390-5116-4327-a967-e22e56d2ac67 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1565 microversion: 2.1 time: 0.178421 Jul 14 10:20:34.820903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 357/703] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:34 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:34.981871 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:34.982519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:34.990510 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.990965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:34.991733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:34.992178 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:35.146672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:35.154841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-18f744c2-7671-4eeb-89c3-f1306f60b588 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1277 microversion: 2.1 time: 0.177557 Jul 14 10:20:35.155416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 347/704] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:34 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:35.829663 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feff101a-70ab-4116-8cdd-d1a42eb3da87"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:35.830652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:35.837466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:35.837877 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:35.838329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:35.838790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:35.838895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:35.839288 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:35.846050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:35.846703 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:35.847583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:35.848316 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:36.023418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f37d419e37b4172b27649775a144ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da859b6d410b4c2b995804fa5ffd190f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:36.032517 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4c4639b7-821b-4168-9fcc-f63dc19e9bd8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 200 len: 1447 microversion: 2.1 time: 0.198580 Jul 14 10:20:36.032998 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 348/705] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:35 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 1447 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:36.076318 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-705c9659-f72e-44d3-87f9-fbd9bea369c3 req-1f446890-2152-4e23-abf5-d2e7cf1d0565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "414a7fe2-8b90-4d6a-a2d0-884211f8d41f", "name": "network-vif-deleted", "tag": "514bf096-233a-451d-b946-24bcc74dc666"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:36.086639 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-705c9659-f72e-44d3-87f9-fbd9bea369c3 req-1f446890-2152-4e23-abf5-d2e7cf1d0565 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:36.087008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-705c9659-f72e-44d3-87f9-fbd9bea369c3 req-1f446890-2152-4e23-abf5-d2e7cf1d0565 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:36.101252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-705c9659-f72e-44d3-87f9-fbd9bea369c3 req-1f446890-2152-4e23-abf5-d2e7cf1d0565 service nova] Creating event network-vif-deleted:514bf096-233a-451d-b946-24bcc74dc666 for instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f on hv-cinder-84980 Jul 14 10:20:36.106645 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-705c9659-f72e-44d3-87f9-fbd9bea369c3 req-1f446890-2152-4e23-abf5-d2e7cf1d0565 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034259 Jul 14 10:20:36.108046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 349/706] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:36.118999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8d0162f0-5d05-4d66-a98e-9e9d4078e04d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "POST /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293223 Jul 14 10:20:36.119794 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 358/707] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:20:35 2022] POST /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:36.180987 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:36.181721 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:36.188598 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:36.189077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:36.189865 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:36.190265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:36.325927 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:36.334233 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4ca877af-e1c9-4652-a573-98e8cf10b598 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.166308 Jul 14 10:20:36.335039 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 350/708] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:36 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:37.047841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:37.048718 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=6 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:37.053109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:37.053823 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] [instance: 414a7fe2-8b90-4d6a-a2d0-884211f8d41f] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:37.060944 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:37.061405 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:37.062178 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:37.062619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:37.075927 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] HTTP exception thrown: Instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f could not be found. Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Request method failure captured: Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f HTTP/1.1 Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-yWxt_AU4PPxR8e_16aTvVFwtfOtWzprqevv5wD92yQ9JRUfQsK4tA7I-CCPsr_pAilfk_k-Gfo_p-3VCb6yjaEn6Py2epCFNj6jYRK1Sq9rWE3qJW8p9B2XMqC-Ac97pZC29WCgoZMrB_r93yhtqyyubvnOZIp6CfBCfXOclpGQ1E Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: da859b6d410b4c2b995804fa5ffd190f Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-TestShelveInstance-1724137592 Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:20:37.077485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_da859b6d410b4c2b995804fa5ffd190f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/da859b6d410b4c2b995804fa5ffd190f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/da859b6d410b4c2b995804fa5ffd190f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/da859b6d410b4c2b995804fa5ffd190f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-TestShelveInstance-1724137592 Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: da859b6d410b4c2b995804fa5ffd190f Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-TestShelveInstance-1724137592 Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-TestShelveInstance-1724137592-project Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 3f37d419e37b4172b27649775a144ca6 Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-TestShelveInstance-1724137592-project Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f could not be found. Jul 14 10:20:37.079022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '414a7fe2-8b90-4d6a-a2d0-884211f8d41f'} Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f could not be found. Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:37.079935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f could not be found. Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f could not be found. Jul 14 10:20:37.081409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:37.082669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Returning 404 to user: Instance 414a7fe2-8b90-4d6a-a2d0-884211f8d41f could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:37.082669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5ad63574-fcee-48c1-8ee3-ecf5572521f8 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f" status: 404 len: 111 microversion: 2.1 time: 0.032445 Jul 14 10:20:37.082669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 359/709] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:37 2022] GET /compute/v2.1/servers/414a7fe2-8b90-4d6a-a2d0-884211f8d41f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:37.242073 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-76a72fb8-6140-42ca-b0c4-89f4d91cf370 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] Calling method '.version_select at 0x7f56257978b0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:37.245542 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:37.281144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-76a72fb8-6140-42ca-b0c4-89f4d91cf370 tempest-TestShelveInstance-1724137592 tempest-TestShelveInstance-1724137592-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-39123578" status: 202 len: 0 microversion: 2.1 time: 0.043752 Jul 14 10:20:37.281632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 351/710] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:20:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-39123578 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:20:37.351594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:37.352342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:37.359550 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:37.360036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:37.360815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:37.361289 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:37.498540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:37.506196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fe1a9c8c-3d4b-4e24-8460-88a72c937bde tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.158520 Jul 14 10:20:37.506772 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 360/711] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:37 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:38.523799 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:38.524574 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:38.531409 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:38.531863 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:38.532640 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:38.533124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:38.664871 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:38.673139 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a8af605a-8ea2-4f47-88b7-3023ee4737ed tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.153893 Jul 14 10:20:38.673703 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 352/712] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:38 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:39.690543 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:39.691097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:39.698526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:39.698988 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:39.700018 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:39.700630 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:39.882768 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:39.891565 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-49468e50-ebde-45b6-b271-0229e3310fc0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.204804 Jul 14 10:20:39.892551 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 361/713] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:39 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:40.909228 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:40.909841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:40.916294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:40.916748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:40.917577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:40.918017 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:41.054478 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:41.062762 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8b3933d9-c26e-4f29-be53-c6532327e173 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.157450 Jul 14 10:20:41.063355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 353/714] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:40 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:42.081018 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:42.082203 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:42.089217 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:42.089855 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:42.091442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:42.091832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:42.272291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:42.282276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-25544e16-217c-46bb-826e-1d7c40736e65 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.205052 Jul 14 10:20:42.283620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 362/715] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:42 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:43.300102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:43.300898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:43.316455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.316941 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.317756 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.318951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.489289 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:43.497361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9fd6f326-430c-4dc7-9457-c07c5879fffa tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.201302 Jul 14 10:20:43.505535 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 354/716] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:43 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:43.717339 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:43.719457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:43.730739 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.731212 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.732033 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.732476 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.772683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9236420a-4ae9-4ef9-89eb-9fdb5c7d07f7 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.061083 Jul 14 10:20:43.773735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 363/717] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:43 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:43.941385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:43.941893 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:43.948226 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.948622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.950015 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.950451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:43.982522 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-896543b0-4149-4f70-b747-eefad887c72f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/91f3ce86-1d0e-47c4-82b0-e97558847a61" status: 200 len: 194 microversion: 2.1 time: 0.045058 Jul 14 10:20:43.983118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 355/718] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Jul 14 10:20:43 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/91f3ce86-1d0e-47c4-82b0-e97558847a61 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:43.992805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:43.993343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:43.999247 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:43.999729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:44.000522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:44.000989 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:44.084405 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lazy-loading 'services' on Instance uuid 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:20:44.180731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d3904651-5f89-455d-b6a0-4b873a6aa09f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/91f3ce86-1d0e-47c4-82b0-e97558847a61" status: 202 len: 0 microversion: 2.1 time: 0.190525 Jul 14 10:20:44.181806 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 364/719] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:20:43 2022] DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/91f3ce86-1d0e-47c4-82b0-e97558847a61 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:20:44.518919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:44.520430 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:44.527193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:44.527738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:44.528630 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:44.529111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:44.669651 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:44.671849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:44.679017 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c4e087e4-9006-4a7c-952a-5acbd64fa2d3 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.164216 Jul 14 10:20:44.679587 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 356/720] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:44 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:45.348074 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:45.348652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:45.355329 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.355773 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.356525 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.356983 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.384974 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-242cfe8a-2963-4acf-ae61-0f874b01a096 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/feff101a-70ab-4116-8cdd-d1a42eb3da87" status: 200 len: 194 microversion: 2.1 time: 0.041571 Jul 14 10:20:45.385552 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 365/721] 10.222.0.61 () {58 vars in 1412 bytes} [Thu Jul 14 10:20:45 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/feff101a-70ab-4116-8cdd-d1a42eb3da87 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:45.397609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:45.398182 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:45.405320 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.405777 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.406534 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.406965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.489059 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lazy-loading 'services' on Instance uuid 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:20:45.552696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-54c93a8c-2ab6-4808-9c1c-da7ad61f2a48 req-dc8e0dc2-93fb-48d1-9fbe-0d9345f30161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a889-2692-4dab-8be3-52a648470261", "name": "network-vif-plugged", "status": "completed", "tag": "843c538b-92d0-432e-89e7-4dcf474bc2e2"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:45.562734 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-54c93a8c-2ab6-4808-9c1c-da7ad61f2a48 req-dc8e0dc2-93fb-48d1-9fbe-0d9345f30161 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.563253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-54c93a8c-2ab6-4808-9c1c-da7ad61f2a48 req-dc8e0dc2-93fb-48d1-9fbe-0d9345f30161 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.564916 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b6fa8b8b-a351-4e95-a034-1e87fb105e78 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/feff101a-70ab-4116-8cdd-d1a42eb3da87" status: 202 len: 0 microversion: 2.1 time: 0.171118 Jul 14 10:20:45.572226 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 357/722] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:20:45 2022] DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments/feff101a-70ab-4116-8cdd-d1a42eb3da87 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:20:45.579521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-54c93a8c-2ab6-4808-9c1c-da7ad61f2a48 req-dc8e0dc2-93fb-48d1-9fbe-0d9345f30161 service nova] Creating event network-vif-plugged:843c538b-92d0-432e-89e7-4dcf474bc2e2 for instance 0878a889-2692-4dab-8be3-52a648470261 on hv-cinder-84980 Jul 14 10:20:45.587670 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-54c93a8c-2ab6-4808-9c1c-da7ad61f2a48 req-dc8e0dc2-93fb-48d1-9fbe-0d9345f30161 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040720 Jul 14 10:20:45.588555 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 366/723] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:45.695951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:45.696681 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:45.704090 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.704545 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.705341 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:45.705782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:45.839059 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:45.847369 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-30d09d4f-2877-4046-b545-94b26dc27496 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.155584 Jul 14 10:20:45.847936 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 358/724] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:45 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:46.737743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:46.738745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:46.744912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.745377 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.746672 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.747102 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.771903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:46.776865 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-69e89e7a-6d4a-4886-8a17-656eeb7e3c32 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 Jul 14 10:20:46.777927 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 367/725] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:46 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:46.863965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:46.864571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:46.871264 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.871717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:46.872472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:46.872904 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:47.006521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:47.014541 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dc8a1d29-9c41-4fb8-bd4e-d76f35207ba8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1265 microversion: 2.1 time: 0.154440 Jul 14 10:20:47.015111 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 359/726] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:46 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:47.788979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:47.789954 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:47.797505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:47.797954 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:47.798711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:47.799146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:47.828954 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3ea2d555-2bed-49a4-a55a-b30fa4015a5f tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043849 Jul 14 10:20:47.829509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 368/727] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:47 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:20:47.939285 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:47.940267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:47.946865 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:47.947324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:47.948092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:47.948530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:47.976429 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-786c7183-9ed2-42b1-93ab-d0cf6ccf057b tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041141 Jul 14 10:20:47.976979 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 360/728] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:20:47 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:20:48.030969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:48.031684 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:48.035567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:48.036133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:48.038254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.038776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.039670 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.040119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.042813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.043843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.044694 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.045329 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.072212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:20:48.158508 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6dcd40ba-0d37-4fb9-8c5e-de0a865ca138 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 204 len: 0 microversion: 2.1 time: 0.126909 Jul 14 10:20:48.162220 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 361/729] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:48 2022] DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 10:20:48.167707 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:48.169173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:48.175352 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.175804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.176582 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.177074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.199055 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:48.211593 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a0efdfa6-2b04-4486-9aa1-4039ebdb81f0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1452 microversion: 2.1 time: 0.184019 Jul 14 10:20:48.212588 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 369/730] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:48 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:48.228888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:48.229666 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:48.236099 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.236595 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.237403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:48.237848 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:48.361123 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:48.368688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-422d4ec8-b0d1-47a4-a1ef-2807f96ab483 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1674 microversion: 2.1 time: 0.205169 Jul 14 10:20:48.369288 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 362/731] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:48 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:48.398694 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:48.406839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a449ff77-32f3-472a-b1fa-a409e46c18b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1452 microversion: 2.1 time: 0.181968 Jul 14 10:20:48.407393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 370/732] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:48 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:49.386401 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:49.387077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:49.394454 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:49.394902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:49.395675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:49.396113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:49.525914 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:49.534316 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e9e9bec4-3f1e-44e0-ba90-38ea5a20ff8d tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1674 microversion: 2.1 time: 0.151810 Jul 14 10:20:49.534967 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 363/733] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:49 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:49.963441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-c6abbf8e-275d-476c-8560-dea7fa0732c6 req-760a16d8-34f5-4f42-94dd-64e7a9a8aa73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0878a889-2692-4dab-8be3-52a648470261", "tag": "843c538b-92d0-432e-89e7-4dcf474bc2e2"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:49.973936 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-c6abbf8e-275d-476c-8560-dea7fa0732c6 req-760a16d8-34f5-4f42-94dd-64e7a9a8aa73 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:49.974444 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-c6abbf8e-275d-476c-8560-dea7fa0732c6 req-760a16d8-34f5-4f42-94dd-64e7a9a8aa73 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:49.986769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-c6abbf8e-275d-476c-8560-dea7fa0732c6 req-760a16d8-34f5-4f42-94dd-64e7a9a8aa73 service nova] Creating event network-changed:843c538b-92d0-432e-89e7-4dcf474bc2e2 for instance 0878a889-2692-4dab-8be3-52a648470261 on hv-cinder-84980 Jul 14 10:20:49.991782 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-c6abbf8e-275d-476c-8560-dea7fa0732c6 req-760a16d8-34f5-4f42-94dd-64e7a9a8aa73 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031968 Jul 14 10:20:49.992383 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 371/734] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:50.553472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:50.554510 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:50.562267 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:50.562800 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:50.563658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:50.564193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:50.793018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:50.802173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-15a0594b-b3f3-4393-b1ba-7a0b03ab58c4 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1674 microversion: 2.1 time: 0.253634 Jul 14 10:20:50.803609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 364/735] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:50 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:20:51.816831 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-835993e3-62a1-45a4-b316-5c24636251cd req-9acfb54f-1f41-4727-8581-e2ecc85bc67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c2418cd-d4dd-4a16-9d70-d601cb1efa76", "name": "network-vif-deleted", "tag": "fd9be155-f5da-4d85-b353-8c3d7b3943c6"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:51.819773 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:51.820388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:51.829721 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-835993e3-62a1-45a4-b316-5c24636251cd req-9acfb54f-1f41-4727-8581-e2ecc85bc67e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:51.830230 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:51.830721 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-835993e3-62a1-45a4-b316-5c24636251cd req-9acfb54f-1f41-4727-8581-e2ecc85bc67e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:51.830835 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:51.831596 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:51.832039 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:51.843701 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-835993e3-62a1-45a4-b316-5c24636251cd req-9acfb54f-1f41-4727-8581-e2ecc85bc67e service nova] Creating event network-vif-deleted:fd9be155-f5da-4d85-b353-8c3d7b3943c6 for instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 on hv-cinder-84980 Jul 14 10:20:51.849470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-835993e3-62a1-45a4-b316-5c24636251cd req-9acfb54f-1f41-4727-8581-e2ecc85bc67e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036512 Jul 14 10:20:51.850255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 372/736] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:51.906995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a9eebc1c8540daa31109cfc86d5ed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4cde0820dc5474eb7091fb3a8de4cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:20:51.915436 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1d52cd0f-67a4-4d4f-99e6-e288680f1af9 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 200 len: 1606 microversion: 2.1 time: 0.099414 Jul 14 10:20:51.916018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 365/737] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:51 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 1606 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:20:52.934144 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:52.934866 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:52.936779 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:52.942487 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:52.942942 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:52.943831 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:52.944306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:52.944306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:52.944489 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:52.947006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:20:52.952843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:52.953331 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:52.954103 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:52.954540 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:52.958699 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] HTTP exception thrown: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Request method failure captured: Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 HTTP/1.1 Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xrJinN3BzM-HZDhGFupsxCT3McFTler_s7jbqXHrwro9Dy5sDcNdiCE83LNh6pHC3jxu_0osd7Qz2hTH4cP4SIiYf2NyuOrYxqbGS4JvXqZ5USMGVsDPxbrJem9CGedGczumkTagwXGOJqd3kvoH1KTgbNQr9oyO4ZbH-PODl0T4k Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:20:52.960321 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a4cde0820dc5474eb7091fb3a8de4cd0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 01a9eebc1c8540daa31109cfc86d5ed1 Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:52.962097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '7c2418cd-d4dd-4a16-9d70-d601cb1efa76'} Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:52.962992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:52.965232 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:52.966587 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Returning 404 to user: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:52.966587 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c200dd5e-5b2d-40d7-91dd-0b077fcc32de tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 404 len: 111 microversion: 2.1 time: 0.032297 Jul 14 10:20:52.966587 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 373/738] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:52 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:52.970708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-98e87ac5-35f4-4611-9e34-703ce276ac36 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '.version_select at 0x7f5625841310>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:52.983302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b3a845b7-977b-4e4b-bc9a-23953cda3120 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/ips" status: 200 len: 148 microversion: 2.1 time: 0.043162 Jul 14 10:20:52.984079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 366/739] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:20:52 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:20:52.993868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-98e87ac5-35f4-4611-9e34-703ce276ac36 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821335812" status: 202 len: 0 microversion: 2.1 time: 0.026640 Jul 14 10:20:52.994459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 374/740] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jul 14 10:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1821335812 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:20:54.318850 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d36839-1ed3-40c9-9eb9-02fbc2fb91c7"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:20:54.319975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:54.326454 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:54.326902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:54.327658 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:54.328091 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:54.560992 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-30c41d35-49fc-4b8b-854b-389ac6c66e5d tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "POST /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245873 Jul 14 10:20:54.561622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 367/741] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:20:54 2022] POST /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:20:55.861584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:55.862066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:55.868714 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:55.869193 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:55.869962 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:55.870405 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:55.883447 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] HTTP exception thrown: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Request method failure captured: Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 HTTP/1.1 Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xrJinN3BzM-HZDhGFupsxCT3McFTler_s7jbqXHrwro9Dy5sDcNdiCE83LNh6pHC3jxu_0osd7Qz2hTH4cP4SIiYf2NyuOrYxqbGS4JvXqZ5USMGVsDPxbrJem9CGedGczumkTagwXGOJqd3kvoH1KTgbNQr9oyO4ZbH-PODl0T4k Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:20:55.884961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a4cde0820dc5474eb7091fb3a8de4cd0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 01a9eebc1c8540daa31109cfc86d5ed1 Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.886496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '7c2418cd-d4dd-4a16-9d70-d601cb1efa76'} Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:55.887364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.888769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.890236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Returning 404 to user: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:55.890236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-60c7d5c2-16e7-4a6f-a658-78cc47bcff13 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 404 len: 111 microversion: 2.1 time: 0.029236 Jul 14 10:20:55.890236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 375/742] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:55 2022] DELETE /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:55.896138 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:55.896833 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: 7c2418cd-d4dd-4a16-9d70-d601cb1efa76] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:55.903509 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:55.903954 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:55.904716 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:55.905177 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:55.918936 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] HTTP exception thrown: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Request method failure captured: Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 HTTP/1.1 Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xrJinN3BzM-HZDhGFupsxCT3McFTler_s7jbqXHrwro9Dy5sDcNdiCE83LNh6pHC3jxu_0osd7Qz2hTH4cP4SIiYf2NyuOrYxqbGS4JvXqZ5USMGVsDPxbrJem9CGedGczumkTagwXGOJqd3kvoH1KTgbNQr9oyO4ZbH-PODl0T4k Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:20:55.920537 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a4cde0820dc5474eb7091fb3a8de4cd0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 01a9eebc1c8540daa31109cfc86d5ed1 Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.922065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '7c2418cd-d4dd-4a16-9d70-d601cb1efa76'} Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:55.922973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. Jul 14 10:20:55.924386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:55.925775 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Returning 404 to user: Instance 7c2418cd-d4dd-4a16-9d70-d601cb1efa76 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:55.925775 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-15611b35-3e2c-4621-91ca-68970331c772 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76" status: 404 len: 111 microversion: 2.1 time: 0.030812 Jul 14 10:20:55.925775 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 368/743] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:55 2022] GET /compute/v2.1/servers/7c2418cd-d4dd-4a16-9d70-d601cb1efa76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:57.053541 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:57.054081 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:57.060474 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:57.060945 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:57.061725 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:57.062168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:57.075713 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] HTTP exception thrown: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Request method failure captured: Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 HTTP/1.1 Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xrJinN3BzM-HZDhGFupsxCT3McFTler_s7jbqXHrwro9Dy5sDcNdiCE83LNh6pHC3jxu_0osd7Qz2hTH4cP4SIiYf2NyuOrYxqbGS4JvXqZ5USMGVsDPxbrJem9CGedGczumkTagwXGOJqd3kvoH1KTgbNQr9oyO4ZbH-PODl0T4k Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:20:57.077269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a4cde0820dc5474eb7091fb3a8de4cd0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 01a9eebc1c8540daa31109cfc86d5ed1 Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.078615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'cb5e53dd-665c-4eb7-a9b9-94555c21df75'} Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:57.079478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.081059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.082690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Returning 404 to user: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:57.082690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-10a2bf18-9b87-4417-9c53-bc18759d2b85 tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 404 len: 111 microversion: 2.1 time: 0.028918 Jul 14 10:20:57.082690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 376/744] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:20:57 2022] DELETE /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:20:57.086804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:20:57.087443 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] [instance: cb5e53dd-665c-4eb7-a9b9-94555c21df75] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:20:57.095229 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:57.095776 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:57.096593 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:20:57.097052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:20:57.112096 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] HTTP exception thrown: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Request method failure captured: Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 HTTP/1.1 Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xrJinN3BzM-HZDhGFupsxCT3McFTler_s7jbqXHrwro9Dy5sDcNdiCE83LNh6pHC3jxu_0osd7Qz2hTH4cP4SIiYf2NyuOrYxqbGS4JvXqZ5USMGVsDPxbrJem9CGedGczumkTagwXGOJqd3kvoH1KTgbNQr9oyO4ZbH-PODl0T4k Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:20:57.113606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a4cde0820dc5474eb7091fb3a8de4cd0", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a4cde0820dc5474eb7091fb3a8de4cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a4cde0820dc5474eb7091fb3a8de4cd0 Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-540886044 Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 01a9eebc1c8540daa31109cfc86d5ed1 Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeTestJSON-540886044-project Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.115133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'cb5e53dd-665c-4eb7-a9b9-94555c21df75'} Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:20:57.116129 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. Jul 14 10:20:57.117674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:20:57.119194 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] Returning 404 to user: Instance cb5e53dd-665c-4eb7-a9b9-94555c21df75 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:20:57.119194 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e7960616-e339-4204-8546-3c3263a25f7a tempest-AttachVolumeTestJSON-540886044 tempest-AttachVolumeTestJSON-540886044-project] 10.222.0.61 "GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75" status: 404 len: 111 microversion: 2.1 time: 0.031913 Jul 14 10:20:57.119194 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 369/745] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:20:57 2022] GET /compute/v2.1/servers/cb5e53dd-665c-4eb7-a9b9-94555c21df75 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:21:00.413826 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:00.414908 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:00.422040 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:00.422492 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:00.423434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:00.424053 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:00.449017 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8bd522d1-a1b7-4975-9898-dda5acdf02e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/ips" status: 200 len: 152 microversion: 2.20 time: 0.038902 Jul 14 10:21:00.450891 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 377/746] 10.222.0.61 () {60 vars in 1288 bytes} [Thu Jul 14 10:21:00 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:21:02.169543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:02.170023 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:02.176522 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.177000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.177754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.178186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.256819 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'services' on Instance uuid f7411091-94a7-46f4-8e0f-43581972d772 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:21:02.325817 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:02.338056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-485ec13f-427d-41a4-ad21-0de55c144f7a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments/98d36839-1ed3-40c9-9eb9-02fbc2fb91c7" status: 202 len: 0 microversion: 2.1 time: 0.172421 Jul 14 10:21:02.338642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 370/747] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:21:02 2022] DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments/98d36839-1ed3-40c9-9eb9-02fbc2fb91c7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:21:02.347698 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:02.348633 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:02.355143 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.355678 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.356453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.356967 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.388202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-03dd52d9-abe0-4cae-90ad-49bc24fe2895 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Jul 14 10:21:02.388764 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 378/748] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:21:02 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:02.430109 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:02.430844 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:02.437897 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.438444 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.439286 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.439792 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.463558 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lazy-loading 'flavor' on Instance uuid 3a1ec4c5-369c-4368-aa74-03211ceea168 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:21:02.713965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b4090f90-cd92-4e24-a60d-38a14527edc1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/action" status: 202 len: 0 microversion: 2.20 time: 0.288414 Jul 14 10:21:02.714677 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 371/749] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jul 14 10:21:02 2022] POST /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:21:02.722765 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:02.723408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:02.729432 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.729889 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.730811 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:02.731252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:02.860756 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:02.861239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4d79b12f-bb2c-4abe-b0a1-e080fafe4d18 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f56257dcaf0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:02.870520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:02.872730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:02.873976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8d7281fc-d9a6-4c70-91de-2ee99365510a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.155109 Jul 14 10:21:02.874522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 379/750] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:02 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:03.064469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4d79b12f-bb2c-4abe-b0a1-e080fafe4d18 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/fe1d5ac9-54c4-45af-8af5-839336f4cf85" status: 200 len: 351 microversion: 2.1 time: 0.207642 Jul 14 10:21:03.065065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 372/751] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:02 2022] GET /compute/v2.1/os-volumes/fe1d5ac9-54c4-45af-8af5-839336f4cf85 => generated 351 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:03.400151 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:03.401166 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:03.408129 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.408608 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.409398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.409844 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.438646 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b24480a5-0462-4bbd-b9ba-667dd330cd94 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042537 Jul 14 10:21:03.439194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 380/752] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:21:03 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:21:03.498888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:03.499505 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:03.505857 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.506309 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.507074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.507519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.532595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:21:03.606682 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0af63274-8c90-4523-a41c-19237d752a6e tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 204 len: 0 microversion: 2.1 time: 0.111269 Jul 14 10:21:03.608038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 373/753] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:21:03 2022] DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:21:03.616972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:03.617683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:03.624004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.624560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.625370 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.625818 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.752231 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:03.759722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9ff7c8a6-1416-4520-95dd-34e998afbf9f tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1681 microversion: 2.1 time: 0.147232 Jul 14 10:21:03.760309 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 381/754] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:03 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:21:03.894317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:03.894966 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:03.901357 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.901804 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:03.903238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:03.903722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:04.034728 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:04.042629 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:04.044232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:04.045428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-22afcb75-860b-4d41-bb8f-943c2ee4722e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.155813 Jul 14 10:21:04.045980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 374/755] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:03 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:04.385775 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4ea919c5-a08b-42b6-b02c-01db303cdc41 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f56258bbdc0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:04.431278 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4ea919c5-a08b-42b6-b02c-01db303cdc41 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/e5b21db9-a22b-4d95-9114-5b775254c617" status: 200 len: 350 microversion: 2.1 time: 0.049260 Jul 14 10:21:04.431837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 382/756] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:04 2022] GET /compute/v2.1/os-volumes/e5b21db9-a22b-4d95-9114-5b775254c617 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:04.777952 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:04.778561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:04.784667 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:04.785165 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:04.785928 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:04.786365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:04.913163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:04.921191 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-85025911-c9eb-4971-b33a-b93d007a1db5 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1681 microversion: 2.1 time: 0.147584 Jul 14 10:21:04.921753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 375/757] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:04 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:21:05.063453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:05.064061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:05.070061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:05.070502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:05.071252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:05.071686 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:05.201120 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:05.209245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:05.210819 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:05.212031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1db32169-7119-45e9-9c31-2490f0de514f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.152433 Jul 14 10:21:05.212665 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 383/758] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:05 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:05.746328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4ba04163-20c4-4b28-8d2d-98aa20d38e32 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f562a1a7430>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:05.793594 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4ba04163-20c4-4b28-8d2d-98aa20d38e32 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0320f58a-5da7-4805-8496-4d8d3885a1a5" status: 200 len: 350 microversion: 2.1 time: 0.050316 Jul 14 10:21:05.799941 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 376/759] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:05 2022] GET /compute/v2.1/os-volumes/0320f58a-5da7-4805-8496-4d8d3885a1a5 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:05.805349 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b052175b-b9a9-4dc4-aab9-4ac444bda916 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f5625867d30>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:05.886328 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b052175b-b9a9-4dc4-aab9-4ac444bda916 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084973 Jul 14 10:21:05.887386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 384/760] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Jul 14 10:21:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:21:05.899493 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5ccc4297-61cf-4421-b328-eb3ba0fdca01 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f562a1a7b80>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:05.938131 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:05.939027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:05.946265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:05.946832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:05.947726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:05.948372 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:05.983098 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5ccc4297-61cf-4421-b328-eb3ba0fdca01 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087337 Jul 14 10:21:05.983807 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 377/761] 10.222.0.61 () {58 vars in 1148 bytes} [Thu Jul 14 10:21:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:05.995419 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d416df5b-80e6-4f7c-bd0c-97beabf0bebb tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f562a1b70d0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.082155 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d416df5b-80e6-4f7c-bd0c-97beabf0bebb tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090461 Jul 14 10:21:06.082808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 378/762] 10.222.0.61 () {58 vars in 1133 bytes} [Thu Jul 14 10:21:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:21:06.094765 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a26ce520-bde3-41db-87d9-a1327abd28ab tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f5625830550>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.128631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:06.136916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4b1db5ab-f5f0-488f-95de-4c71cb203552 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1681 microversion: 2.1 time: 0.202180 Jul 14 10:21:06.137608 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 385/763] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:05 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:21:06.179594 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a26ce520-bde3-41db-87d9-a1327abd28ab tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088661 Jul 14 10:21:06.180161 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 379/764] 10.222.0.61 () {58 vars in 1166 bytes} [Thu Jul 14 10:21:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:06.193285 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-33a1a289-40e0-4dd6-82d7-e4c1d7bdfc80 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f5625867af0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.231628 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.232491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:06.238733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:06.239205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:06.240162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:06.240751 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:06.279354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-33a1a289-40e0-4dd6-82d7-e4c1d7bdfc80 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089652 Jul 14 10:21:06.280710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 386/765] 10.222.0.61 () {58 vars in 1169 bytes} [Thu Jul 14 10:21:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:06.292335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-febe49e0-50f3-45c1-a916-161463fd1753 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f56258bb430>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.375700 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-febe49e0-50f3-45c1-a916-161463fd1753 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087068 Jul 14 10:21:06.380037 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 387/766] 10.222.0.61 () {58 vars in 1154 bytes} [Thu Jul 14 10:21:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:21:06.388569 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e46cacdb-2747-4331-aeb1-f2040d1a5525 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f562586b310>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.452222 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:06.460513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:06.462064 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:06.463232 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d89176c2-824b-4597-ac6d-3242f44ad5bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.236378 Jul 14 10:21:06.466717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 380/767] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:06 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:06.474202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e46cacdb-2747-4331-aeb1-f2040d1a5525 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090487 Jul 14 10:21:06.474760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 388/768] 10.222.0.61 () {58 vars in 1187 bytes} [Thu Jul 14 10:21:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:06.486990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-414476e9-b36a-4aae-a214-cf9191c5b185 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] Calling method '.version_select at 0x7f5625789ee0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:06.571822 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-414476e9-b36a-4aae-a214-cf9191c5b185 tempest-VolumesTestJSON-846001464 tempest-VolumesTestJSON-846001464-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088685 Jul 14 10:21:06.572712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 381/769] 10.222.0.61 () {58 vars in 1154 bytes} [Thu Jul 14 10:21:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:21:06.593155 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-81d3987d-aa92-4d30-8a80-9f66a849e318 req-c81544bf-659e-4231-997a-46d2a307b346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7411091-94a7-46f4-8e0f-43581972d772", "name": "network-vif-deleted", "tag": "2a830823-d4db-40c7-8cf3-b5e63383422a"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:06.602462 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-81d3987d-aa92-4d30-8a80-9f66a849e318 req-c81544bf-659e-4231-997a-46d2a307b346 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:06.602835 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-81d3987d-aa92-4d30-8a80-9f66a849e318 req-c81544bf-659e-4231-997a-46d2a307b346 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:06.615642 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-81d3987d-aa92-4d30-8a80-9f66a849e318 req-c81544bf-659e-4231-997a-46d2a307b346 service nova] Creating event network-vif-deleted:2a830823-d4db-40c7-8cf3-b5e63383422a for instance f7411091-94a7-46f4-8e0f-43581972d772 on hv-cinder-84980 Jul 14 10:21:06.621412 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-81d3987d-aa92-4d30-8a80-9f66a849e318 req-c81544bf-659e-4231-997a-46d2a307b346 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034828 Jul 14 10:21:06.622607 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 389/770] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:07.154660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:07.155618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:07.163386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:07.163922 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:07.164763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:07.165294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:07.198858 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:07.199418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:07.199947 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lazy-loading 'fault' on Instance uuid f7411091-94a7-46f4-8e0f-43581972d772 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:21:07.243772 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bff5f2d1367545f2b4c77fe0d9f095ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5056f0a32e37430ea3ea63d9cb69bf2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:07.256660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b43cbc70-9a3b-492f-8ad3-f309d6c4d625 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 200 len: 1332 microversion: 2.1 time: 0.106294 Jul 14 10:21:07.257283 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 382/771] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:07 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:21:07.483827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:07.484749 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:07.491195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:07.491656 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:07.492427 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:07.492870 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:07.630979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:07.638914 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:07.640409 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:07.641585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f823f07c-cf4a-41f3-b701-df001082b451 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.163057 Jul 14 10:21:07.642140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 390/772] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:07 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:08.274146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:08.274752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:08.281413 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:08.281854 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:08.282604 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:08.283033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:08.295996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 HTTP/1.1 Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:08.297619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:08.299200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'f7411091-94a7-46f4-8e0f-43581972d772'} Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:08.300159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:08.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:08.302684 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:08.302684 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2419a7df-8b63-4a9b-bd2d-daf8424bc2a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 404 len: 111 microversion: 2.1 time: 0.028638 Jul 14 10:21:08.302684 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 383/773] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:08 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:08.307876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c00eabf5-520d-46b6-976c-c45ace75af90 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '.version_select at 0x7f56258bb940>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:08.326410 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c00eabf5-520d-46b6-976c-c45ace75af90 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531765549" status: 202 len: 0 microversion: 2.1 time: 0.022235 Jul 14 10:21:08.326901 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 391/774] 10.222.0.61 () {58 vars in 1220 bytes} [Thu Jul 14 10:21:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531765549 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:21:08.660423 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:08.661098 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:08.667033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:08.667491 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:08.669001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:08.669447 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:08.801322 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:08.809796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:08.811317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:08.812476 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-08c2b032-691c-4fb7-8a96-0011e84ff003 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.155950 Jul 14 10:21:08.813049 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 384/775] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:08 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:09.831973 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:09.832511 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:09.838606 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:09.839060 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:09.840341 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:09.840783 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:09.968827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:09.976695 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:09.978253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:09.979408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f911e505-b243-4085-bd5c-2bd48e2c0859 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.151975 Jul 14 10:21:09.979961 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 392/776] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:09 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:10.063708 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:10.064231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:10.070802 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:10.071468 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:10.072236 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:10.072672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:10.085897 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 HTTP/1.1 Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:10.087499 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.089040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'f7411091-94a7-46f4-8e0f-43581972d772'} Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:10.089935 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.091392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.097644 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:10.098973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-909d917b-3b90-4775-ab61-e7ddf9013acd tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 404 len: 111 microversion: 2.1 time: 0.038839 Jul 14 10:21:10.102718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 385/777] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:21:10 2022] DELETE /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:10.108798 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:10.109456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: f7411091-94a7-46f4-8e0f-43581972d772] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:10.115476 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:10.115931 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:10.116696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:10.117169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:10.131057 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 HTTP/1.1 Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:10.132728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.134638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'f7411091-94a7-46f4-8e0f-43581972d772'} Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:10.139567 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. Jul 14 10:21:10.140966 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:10.142348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance f7411091-94a7-46f4-8e0f-43581972d772 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:10.142348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2583e984-0950-48b6-a8e1-90b7c2d60abe tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772" status: 404 len: 111 microversion: 2.1 time: 0.030070 Jul 14 10:21:10.142348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 393/778] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:10 2022] GET /compute/v2.1/servers/f7411091-94a7-46f4-8e0f-43581972d772 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:10.997916 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:10.998528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:11.004649 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.005131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.005906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.006360 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.142776 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:11.151402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:11.154329 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:11.155588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-046fd2cd-c51e-447d-9f25-bd9938f8b471 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.162170 Jul 14 10:21:11.156152 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 386/779] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:10 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:11.274819 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:11.275423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:11.282540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.282994 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.283760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.284195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.298310 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad HTTP/1.1 Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:11.299854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.301491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '5e077b2f-2c84-41d9-9f6d-d8a4637b2fad'} Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:11.302358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.303791 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.305184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:11.305184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-03a94291-afcc-44ed-b559-2a44cc104906 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 404 len: 111 microversion: 2.1 time: 0.030274 Jul 14 10:21:11.305184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 394/780] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:21:11 2022] DELETE /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:11.309640 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:11.310245 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:11.316133 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.316575 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.317437 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.317875 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.330864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad HTTP/1.1 Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:11.332365 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.333912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '5e077b2f-2c84-41d9-9f6d-d8a4637b2fad'} Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:11.334733 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. Jul 14 10:21:11.336294 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.337579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 5e077b2f-2c84-41d9-9f6d-d8a4637b2fad could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:11.337579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f792a4e7-653f-4402-8782-01419970607b tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad" status: 404 len: 111 microversion: 2.1 time: 0.027946 Jul 14 10:21:11.337579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 387/781] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:11 2022] GET /compute/v2.1/servers/5e077b2f-2c84-41d9-9f6d-d8a4637b2fad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:11.342723 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:11.343221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:11.350070 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.350547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.351317 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.351784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.366279 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e HTTP/1.1 Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:11.368022 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.369618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '48291869-495a-4466-a05f-86a03663c24e'} Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:11.370507 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.371909 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.373538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:11.373538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-91cabd4c-7987-4154-af7b-5e2c0a0097b1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 404 len: 111 microversion: 2.1 time: 0.031100 Jul 14 10:21:11.373538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 395/782] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:21:11 2022] DELETE /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:11.379371 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:11.380002 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 48291869-495a-4466-a05f-86a03663c24e] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:11.385993 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.386467 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.387223 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:11.387653 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e HTTP/1.1 Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:11.406269 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.408078 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '48291869-495a-4466-a05f-86a03663c24e'} Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:11.409099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. Jul 14 10:21:11.410764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:11.412231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 48291869-495a-4466-a05f-86a03663c24e could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:11.412231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-056d47d8-f658-43e6-b071-76b54f17190a tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e" status: 404 len: 111 microversion: 2.1 time: 0.030836 Jul 14 10:21:11.412231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 388/783] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:11 2022] GET /compute/v2.1/servers/48291869-495a-4466-a05f-86a03663c24e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:12.174443 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:12.175092 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:12.181731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:12.182502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:12.183279 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:12.183715 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:12.325449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:12.335255 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:12.337668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:12.338988 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-70d6fd09-9688-4685-a802-ca0550edf92d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.168844 Jul 14 10:21:12.339711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 396/784] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:12 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:12.540375 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:12.540855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:12.547969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:12.548420 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:12.549202 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:12.549639 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:12.563503 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 HTTP/1.1 Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:12.565087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.566660 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '79ac6d8d-492d-45da-ac13-5688fc6e2bb6'} Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:12.568047 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.569656 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.571137 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:12.571137 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-963f31d6-6c0f-4390-942d-44be1ab66cec tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 404 len: 111 microversion: 2.1 time: 0.029870 Jul 14 10:21:12.571137 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 389/785] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:21:12 2022] DELETE /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:12.575000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:12.575618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] [instance: 79ac6d8d-492d-45da-ac13-5688fc6e2bb6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:12.581740 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:12.582196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:12.582964 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:12.583408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:12.597253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] HTTP exception thrown: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Request method failure captured: Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 HTTP/1.1 Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-xmTr98jrODlDhArhe3FIlBDHlDzgZOc2x_00fRSPRcwHBr_tLe9y2-bUyzV-CettTYIqUmOdNh6z7Nc4hOXd0unZPg3tBoPR7KgmwGKhZLtQ-tmVo6jCHqtDQMnlZjKptnwvCCtg2HhSdOOa43cWr4oCxqQA5UXYCKq8EPLWXIhu4 Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:12.598777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5056f0a32e37430ea3ea63d9cb69bf2b", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5056f0a32e37430ea3ea63d9cb69bf2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 5056f0a32e37430ea3ea63d9cb69bf2b Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-577237363 Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bff5f2d1367545f2b4c77fe0d9f095ab Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeNegativeTest-577237363-project Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.600398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '79ac6d8d-492d-45da-ac13-5688fc6e2bb6'} Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:12.601435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. Jul 14 10:21:12.602655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:12.603895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] Returning 404 to user: Instance 79ac6d8d-492d-45da-ac13-5688fc6e2bb6 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:12.603895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-763289c7-0364-4640-90e0-e907985182a1 tempest-AttachVolumeNegativeTest-577237363 tempest-AttachVolumeNegativeTest-577237363-project] 10.222.0.61 "GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6" status: 404 len: 111 microversion: 2.1 time: 0.029253 Jul 14 10:21:12.603895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 397/786] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:21:12 2022] GET /compute/v2.1/servers/79ac6d8d-492d-45da-ac13-5688fc6e2bb6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:13.357726 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:13.358675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:13.365146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:13.365528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:13.366302 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:13.366915 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:13.606050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:13.615139 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:13.616718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:13.617846 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-decbb5a6-f6ca-4daf-b271-fac869701456 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.264057 Jul 14 10:21:13.618571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 390/787] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:13 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:14.637181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:14.637181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:14.643939 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:14.644403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:14.645211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:14.645704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:14.662046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=100 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:14.856584 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:14.865916 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:14.867486 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:14.868700 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1273ed66-0372-4c0d-a4ba-7a1f3e80655e tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.236970 Jul 14 10:21:14.869285 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 398/788] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:14 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:15.888340 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:15.889738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:15.905304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:15.905762 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:15.906823 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:15.907674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:16.205688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:16.217970 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:16.219531 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:16.220728 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-45391869-cee4-4cdd-8799-4e3c5c18c9fb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.337339 Jul 14 10:21:16.242156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 391/789] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:15 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:17.252188 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:17.253029 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:17.265347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:17.266058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:17.267654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:17.268888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:17.428009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:17.442290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:17.442290 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:17.442639 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9a972390-a252-4fe5-b040-c53caa0a74fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.196199 Jul 14 10:21:17.443350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 399/790] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:17 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:17.724112 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0ff59b2e-8fe1-48ce-9fa7-a6a3feaf3bab tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Action: 'create', calling method: .version_select at 0x7f562a1b74c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1310017371"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:18.013961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0ff59b2e-8fe1-48ce-9fa7-a6a3feaf3bab tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.403818 Jul 14 10:21:18.014694 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 392/791] 10.222.0.61 () {60 vars in 1154 bytes} [Thu Jul 14 10:21:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 405 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 10:21:18.027149 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d5d37751-c15e-451d-9641-cc9ca79c7ebd tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562586b550>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:18.077819 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d5d37751-c15e-451d-9641-cc9ca79c7ebd tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 200 len: 345 microversion: 2.1 time: 0.055926 Jul 14 10:21:18.078510 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 400/792] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:18 2022] GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:18.463083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:18.463785 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:18.471801 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:18.472249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:18.473110 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:18.473569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:18.616528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:18.619290 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:18.627692 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:18.629246 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:18.630457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-077c0e33-95c1-4083-bf77-cbfc18a4e7b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1744 microversion: 2.20 time: 0.171414 Jul 14 10:21:18.631018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 393/793] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:18 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:19.091410 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f2ccb77b-7159-4379-9a29-4a008df6ae8b tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f5625854280>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:19.139913 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f2ccb77b-7159-4379-9a29-4a008df6ae8b tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 200 len: 346 microversion: 2.1 time: 0.053256 Jul 14 10:21:19.140530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 401/794] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:19 2022] GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:19.152626 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fdbb6e3c-998e-497e-a502-3a1db48c1892 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Action: 'create', calling method: .version_select at 0x7f562a1a7f70>, body: {"snapshot": {"volume_id": "b0f51a77-923e-43cc-a5ac-1b1882174f31", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1213085441"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:19.310768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fdbb6e3c-998e-497e-a502-3a1db48c1892 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.162835 Jul 14 10:21:19.311349 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 394/795] 10.222.0.61 () {60 vars in 1161 bytes} [Thu Jul 14 10:21:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:19.322310 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-058f9d50-a26c-40e8-8431-8987ce7063af tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f56258d1ca0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:19.357745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-058f9d50-a26c-40e8-8431-8987ce7063af tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 287 microversion: 2.1 time: 0.040480 Jul 14 10:21:19.358320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 402/796] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:19 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:19.368503 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b9877ef9-c4a6-4d70-a871-eef98314d133 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f56257e7d30>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:19.398310 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b9877ef9-c4a6-4d70-a871-eef98314d133 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033601 Jul 14 10:21:19.398890 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 395/797] 10.222.0.61 () {58 vars in 1139 bytes} [Thu Jul 14 10:21:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:19.408915 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-639206cd-e4b2-42fd-9146-a5584d00e2bf tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f5625841dc0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:19.439407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-639206cd-e4b2-42fd-9146-a5584d00e2bf tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 287 microversion: 2.1 time: 0.034283 Jul 14 10:21:19.439955 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 403/798] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:19 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:19.649276 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:19.649890 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:19.657591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:19.658045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:19.658814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:19.659438 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:19.811996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:19.820082 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:19.821647 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:19.822803 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c0e1d415-c570-4447-b562-7a011052ecf9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1744 microversion: 2.20 time: 0.177573 Jul 14 10:21:19.823392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 396/799] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:19 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:20.451138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-72d7892e-b907-47a1-be57-4dda8f4e114f tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562586b820>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:20.481950 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-72d7892e-b907-47a1-be57-4dda8f4e114f tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 287 microversion: 2.1 time: 0.035045 Jul 14 10:21:20.482515 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 404/800] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:20 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:20.840912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:20.841580 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:20.848062 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:20.848515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:20.849307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:20.849749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:20.984610 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:20.993373 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:20.996137 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:20.997683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dbb57eed-0b8d-45a9-bb69-5c412a01384d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1744 microversion: 2.20 time: 0.161179 Jul 14 10:21:21.006483 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 397/801] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:20 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:21.494385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6d5322aa-be0d-4b4d-9a12-b0d54eb96d3e tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562587ec10>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:21.524711 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6d5322aa-be0d-4b4d-9a12-b0d54eb96d3e tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 287 microversion: 2.1 time: 0.034682 Jul 14 10:21:21.525300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 405/802] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:21 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:22.023337 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:22.023950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:22.031070 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:22.031526 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:22.032288 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:22.032728 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:22.169251 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:22.177172 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:22.178665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:22.179842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7c183e25-0050-4778-9bfe-90d529eb9d6a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1744 microversion: 2.20 time: 0.160392 Jul 14 10:21:22.180391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 398/803] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:22 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:22.535878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-210d5e84-cf69-4c18-88fb-2729fffefef5 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562586b550>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:22.565900 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-210d5e84-cf69-4c18-88fb-2729fffefef5 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 287 microversion: 2.1 time: 0.034221 Jul 14 10:21:22.566538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 406/804] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:22 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:23.197669 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:23.198395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:23.200763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:23.206727 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:23.207764 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:23.208947 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:23.209402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:23.359189 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:23.375754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:23.377295 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:23.378456 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-18a8bd1d-49e0-4a16-be27-0b99ea342405 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.184785 Jul 14 10:21:23.379036 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 399/805] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:23 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:23.582535 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-315ed2d4-abad-4ca8-9456-8c7804d99ad6 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f5625841310>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:23.630361 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-315ed2d4-abad-4ca8-9456-8c7804d99ad6 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 288 microversion: 2.1 time: 0.055854 Jul 14 10:21:23.630932 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 407/806] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:23 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:23.647450 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7b741b07-8192-427d-9079-251c4fa03c23 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562a1a7d30>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:23.719801 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7b741b07-8192-427d-9079-251c4fa03c23 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 202 len: 0 microversion: 2.1 time: 0.076128 Jul 14 10:21:23.720439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 400/807] 10.222.0.61 () {58 vars in 1253 bytes} [Thu Jul 14 10:21:23 2022] DELETE /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:21:23.730106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-524dc640-1914-4429-9835-bf63b95be4c1 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f5625854670>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:23.771576 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-524dc640-1914-4429-9835-bf63b95be4c1 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 200 len: 287 microversion: 2.1 time: 0.045594 Jul 14 10:21:23.772483 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 408/808] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:23 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:24.397923 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:24.398758 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:24.407903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:24.408471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:24.409439 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:24.410139 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:24.573823 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:24.583408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:24.584955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:24.586144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cd3f1208-83e5-4973-99ce-72c4eff3de95 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.192642 Jul 14 10:21:24.586704 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 401/809] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:24 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:24.612221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-7d13a857-b10e-45f2-b3fd-d19d978d8ea9 req-dea5082b-0645-4d51-9342-d40c2402ae26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "name": "network-vif-plugged", "status": "completed", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:24.616484 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:24.634214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7d13a857-b10e-45f2-b3fd-d19d978d8ea9 req-dea5082b-0645-4d51-9342-d40c2402ae26 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:24.634685 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7d13a857-b10e-45f2-b3fd-d19d978d8ea9 req-dea5082b-0645-4d51-9342-d40c2402ae26 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:24.666580 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-7d13a857-b10e-45f2-b3fd-d19d978d8ea9 req-dea5082b-0645-4d51-9342-d40c2402ae26 service nova] Creating event network-vif-plugged:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:21:24.673886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-7d13a857-b10e-45f2-b3fd-d19d978d8ea9 req-dea5082b-0645-4d51-9342-d40c2402ae26 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067600 Jul 14 10:21:24.675208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 409/810] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:21:24.784903 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-875c1397-9eb6-4983-886f-397bb8b042b9 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562a1a7550>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:24.812800 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-875c1397-9eb6-4983-886f-397bb8b042b9 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] HTTP exception thrown: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-875c1397-9eb6-4983-886f-397bb8b042b9 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Request method failure captured: Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b HTTP/1.1 Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-4dhGwBwYANWRTzNNc3RVGDIKZxFNc5spSIVBX3ls02NLo8U7hOlVoOi5cYzbasvSEzcuBs8NQwR3l1oY10EcIql1_rxpgKxfh4cIEgwSjIrrI5Txb_L9nXWK-H8PSw6gYa9U097Z74RAxvOcRTdNxGarTTeSTV7i_bStq3BllGH-o Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:24.815548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a6b58555ffa54e14b2d4878f1c502792", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: f6b248b625d542c385f4da1b2a797cb4 Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '4f8931db-47bc-4531-a310-a229aa0dc89b'} Jul 14 10:21:24.816990 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. (HTTP 404) (Request-ID: req-5b4574bc-2e13-4241-8541-2a29809bd72d) Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.817852 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:24.819141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 10:21:24.820570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-875c1397-9eb6-4983-886f-397bb8b042b9 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Returning 404 to user: Snapshot 4f8931db-47bc-4531-a310-a229aa0dc89b could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-875c1397-9eb6-4983-886f-397bb8b042b9 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b" status: 404 len: 111 microversion: 2.1 time: 0.036368 Jul 14 10:21:24.822145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 402/811] 10.222.0.61 () {58 vars in 1250 bytes} [Thu Jul 14 10:21:24 2022] GET /compute/v2.1/os-snapshots/4f8931db-47bc-4531-a310-a229aa0dc89b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:24.829205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d3071ca9-54cc-4baf-a9c2-60080a9ec0de tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f5625841dc0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:24.907126 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d3071ca9-54cc-4baf-a9c2-60080a9ec0de tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 202 len: 0 microversion: 2.1 time: 0.081997 Jul 14 10:21:24.911721 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 410/812] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:21:24 2022] DELETE /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:21:24.919057 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5fbe8b34-cb0a-41c7-9219-36b87ae10c53 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f56257e4f70>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:24.984359 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5fbe8b34-cb0a-41c7-9219-36b87ae10c53 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 200 len: 345 microversion: 2.1 time: 0.071077 Jul 14 10:21:24.991135 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 403/813] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:24 2022] GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:25.611122 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:25.612382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:25.620314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:25.620801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:25.621618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:25.622211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:25.783165 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:25.793130 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:25.794869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:25.796418 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5764db55-862d-493b-9630-5dbf53374645 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.190637 Jul 14 10:21:25.797412 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 411/814] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:25 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:26.002986 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6c839ca2-c0e6-4b83-9c7a-9e405622d103 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f56259bd040>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:26.032028 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-6c839ca2-c0e6-4b83-9c7a-9e405622d103 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] HTTP exception thrown: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6c839ca2-c0e6-4b83-9c7a-9e405622d103 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Request method failure captured: Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 HTTP/1.1 Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-4dhGwBwYANWRTzNNc3RVGDIKZxFNc5spSIVBX3ls02NLo8U7hOlVoOi5cYzbasvSEzcuBs8NQwR3l1oY10EcIql1_rxpgKxfh4cIEgwSjIrrI5Txb_L9nXWK-H8PSw6gYa9U097Z74RAxvOcRTdNxGarTTeSTV7i_bStq3BllGH-o Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:26.034366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a6b58555ffa54e14b2d4878f1c502792", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: f6b248b625d542c385f4da1b2a797cb4 Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'b0f51a77-923e-43cc-a5ac-1b1882174f31'} Jul 14 10:21:26.035889 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. (HTTP 404) (Request-ID: req-28d83c05-614c-453e-84b3-aaaf2b0f21c4) Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.036830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:26.038683 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 10:21:26.040174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6c839ca2-c0e6-4b83-9c7a-9e405622d103 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Returning 404 to user: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6c839ca2-c0e6-4b83-9c7a-9e405622d103 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 404 len: 109 microversion: 2.1 time: 0.037299 Jul 14 10:21:26.041642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 404/815] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:25 2022] GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:26.046906 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5197bd75-3f12-44da-b1ed-ff89762d6069 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f56258bb820>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:26.080148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-5197bd75-3f12-44da-b1ed-ff89762d6069 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] HTTP exception thrown: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5197bd75-3f12-44da-b1ed-ff89762d6069 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Request method failure captured: Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 HTTP/1.1 Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-4dhGwBwYANWRTzNNc3RVGDIKZxFNc5spSIVBX3ls02NLo8U7hOlVoOi5cYzbasvSEzcuBs8NQwR3l1oY10EcIql1_rxpgKxfh4cIEgwSjIrrI5Txb_L9nXWK-H8PSw6gYa9U097Z74RAxvOcRTdNxGarTTeSTV7i_bStq3BllGH-o Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:26.083801 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a6b58555ffa54e14b2d4878f1c502792", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: f6b248b625d542c385f4da1b2a797cb4 Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'b0f51a77-923e-43cc-a5ac-1b1882174f31'} Jul 14 10:21:26.085488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. (HTTP 404) (Request-ID: req-6a5ee406-0794-4b22-8b44-b539bbdf9ae6) Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.086475 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:21:26.087875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 10:21:26.089613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.090892 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.093437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5197bd75-3f12-44da-b1ed-ff89762d6069 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Returning 404 to user: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:26.094399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5197bd75-3f12-44da-b1ed-ff89762d6069 tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 404 len: 109 microversion: 2.1 time: 0.051237 Jul 14 10:21:26.098259 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 412/816] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:21:26 2022] DELETE /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:26.103959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5302eb02-9649-4038-be7a-66af17b8f82d tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Calling method '.version_select at 0x7f562589f8b0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:26.145745 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-5302eb02-9649-4038-be7a-66af17b8f82d tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] HTTP exception thrown: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5302eb02-9649-4038-be7a-66af17b8f82d tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Request method failure captured: Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 HTTP/1.1 Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-4dhGwBwYANWRTzNNc3RVGDIKZxFNc5spSIVBX3ls02NLo8U7hOlVoOi5cYzbasvSEzcuBs8NQwR3l1oY10EcIql1_rxpgKxfh4cIEgwSjIrrI5Txb_L9nXWK-H8PSw6gYa9U097Z74RAxvOcRTdNxGarTTeSTV7i_bStq3BllGH-o Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:26.147742 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a6b58555ffa54e14b2d4878f1c502792", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a6b58555ffa54e14b2d4878f1c502792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: a6b58555ffa54e14b2d4878f1c502792 Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-240169312 Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: f6b248b625d542c385f4da1b2a797cb4 Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-240169312-project Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'b0f51a77-923e-43cc-a5ac-1b1882174f31'} Jul 14 10:21:26.149145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. (HTTP 404) (Request-ID: req-18f524dc-1319-46e0-8b07-1f090043e59a) Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.150097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:26.152122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 10:21:26.153572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-5302eb02-9649-4038-be7a-66af17b8f82d tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] Returning 404 to user: Volume b0f51a77-923e-43cc-a5ac-1b1882174f31 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-5302eb02-9649-4038-be7a-66af17b8f82d tempest-VolumesSnapshotsTestJSON-240169312 tempest-VolumesSnapshotsTestJSON-240169312-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31" status: 404 len: 109 microversion: 2.1 time: 0.049858 Jul 14 10:21:26.155077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 405/817] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:26 2022] GET /compute/v2.1/os-volumes/b0f51a77-923e-43cc-a5ac-1b1882174f31 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 10:21:26.815067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:26.815766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:26.827415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:26.828175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:26.829172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:26.829777 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:27.033790 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:27.047345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:27.048882 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:27.052100 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7b76572b-2080-43f6-9878-2cafdc9b45c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.240947 Jul 14 10:21:27.053704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 413/818] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:26 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:28.023022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-67921880-9796-4168-b0c4-1c12463a1806 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Action: 'create', calling method: .version_select at 0x7f56257e43a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1838639076", "metadata": {"Type": "work"}}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-67921880-9796-4168-b0c4-1c12463a1806 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Request method failure captured: Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 122 Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-4nVx3TVMmUkh3QaNW9ezPKRTnHDiobR6GzhOFE9LByr1rEu4o3X0znwj6xiIsH8iojx9odiPsqWub3cZE9n9-9wgz3t5ZT1a1vw7t3baWtZG3qpqwIbrUc7yqenaJ5XKSiaVLbGGMi0yeY7whyVWvrR3OletzNHWKhSHqiYmTF6To Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:21:28.053680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2e6d00592a534987ad4e2e4a5062b599", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: bbfe723698da479f99fc508137a3c9a3 Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1838639076", "metadata": {"Type": "work"}}} Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: Jul 14 10:21:28.055404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1838639076', 'metadata': {'Type': 'work'}}}} Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise error Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:28.056459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 10:21:28.058319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 10:21:28.059743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 10:21:28.059743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.059743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-67921880-9796-4168-b0c4-1c12463a1806 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:28.059743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-67921880-9796-4168-b0c4-1c12463a1806 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169597 Jul 14 10:21:28.060074 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 406/819] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jul 14 10:21:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:21:28.068860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6b8f11d9-a917-4dbe-8cfe-a7d770a217af tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Action: 'create', calling method: .version_select at 0x7f5625841700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1380746058", "metadata": {"Type": "work"}}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:28.070793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:28.071468 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6b8f11d9-a917-4dbe-8cfe-a7d770a217af tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Request method failure captured: Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 120 Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-4nVx3TVMmUkh3QaNW9ezPKRTnHDiobR6GzhOFE9LByr1rEu4o3X0znwj6xiIsH8iojx9odiPsqWub3cZE9n9-9wgz3t5ZT1a1vw7t3baWtZG3qpqwIbrUc7yqenaJ5XKSiaVLbGGMi0yeY7whyVWvrR3OletzNHWKhSHqiYmTF6To Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:28.072322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2e6d00592a534987ad4e2e4a5062b599", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bbfe723698da479f99fc508137a3c9a3 Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1380746058", "metadata": {"Type": "work"}}} Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: Jul 14 10:21:28.074520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1380746058', 'metadata': {'Type': 'work'}}}} Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise error Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi '0' Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:28.075499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 10:21:28.077888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 10:21:28.084296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 10:21:28.084296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.084296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6b8f11d9-a917-4dbe-8cfe-a7d770a217af tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:28.084296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6b8f11d9-a917-4dbe-8cfe-a7d770a217af tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009359 Jul 14 10:21:28.084296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 414/820] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jul 14 10:21:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:21:28.086517 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:28.087045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:28.087887 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:28.088392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:28.092789 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1409881b-e08b-44d5-8d7c-fd29d83fe7f7 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Action: 'create', calling method: .version_select at 0x7f56258364c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-947387688", "metadata": {"Type": "work"}}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1409881b-e08b-44d5-8d7c-fd29d83fe7f7 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Request method failure captured: Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 118 Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-4nVx3TVMmUkh3QaNW9ezPKRTnHDiobR6GzhOFE9LByr1rEu4o3X0znwj6xiIsH8iojx9odiPsqWub3cZE9n9-9wgz3t5ZT1a1vw7t3baWtZG3qpqwIbrUc7yqenaJ5XKSiaVLbGGMi0yeY7whyVWvrR3OletzNHWKhSHqiYmTF6To Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:28.095215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2e6d00592a534987ad4e2e4a5062b599", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bbfe723698da479f99fc508137a3c9a3 Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-947387688", "metadata": {"Type": "work"}}} Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: Jul 14 10:21:28.096827 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-947387688', 'metadata': {'Type': 'work'}}}} Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise error Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi '' Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:28.097878 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 10:21:28.099485 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 10:21:28.100849 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 10:21:28.100849 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.100849 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1409881b-e08b-44d5-8d7c-fd29d83fe7f7 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:28.100849 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1409881b-e08b-44d5-8d7c-fd29d83fe7f7 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011162 Jul 14 10:21:28.100849 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 415/821] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Jul 14 10:21:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:21:28.113482 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ff5f5c24-20f4-428a-aeca-7be3d2c7420b tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Calling method '.version_select at 0x7f56258bbdc0>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:28.145406 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-ff5f5c24-20f4-428a-aeca-7be3d2c7420b tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] HTTP exception thrown: Volume tempest-invalid-651279636 could not be found. Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ff5f5c24-20f4-428a-aeca-7be3d2c7420b tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Request method failure captured: Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-651279636 HTTP/1.1 Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-4nVx3TVMmUkh3QaNW9ezPKRTnHDiobR6GzhOFE9LByr1rEu4o3X0znwj6xiIsH8iojx9odiPsqWub3cZE9n9-9wgz3t5ZT1a1vw7t3baWtZG3qpqwIbrUc7yqenaJ5XKSiaVLbGGMi0yeY7whyVWvrR3OletzNHWKhSHqiYmTF6To Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:28.147532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2e6d00592a534987ad4e2e4a5062b599", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bbfe723698da479f99fc508137a3c9a3 Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Volume tempest-invalid-651279636 could not be found. Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'tempest-invalid-651279636'} Jul 14 10:21:28.148975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-651279636 could not be found. (HTTP 404) (Request-ID: req-9f79c8ca-e0ba-4dc2-ac26-3af317250515) Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.149799 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:21:28.151044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-651279636 could not be found. Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:28.152275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-651279636 could not be found. Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-651279636 could not be found. Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ff5f5c24-20f4-428a-aeca-7be3d2c7420b tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Returning 404 to user: Volume tempest-invalid-651279636 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:28.155562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ff5f5c24-20f4-428a-aeca-7be3d2c7420b tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-651279636" status: 404 len: 98 microversion: 2.1 time: 0.039943 Jul 14 10:21:28.166445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 416/822] 10.222.0.61 () {58 vars in 1214 bytes} [Thu Jul 14 10:21:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-651279636 => generated 98 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 10:21:28.174934 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-567292b5-192c-4e18-8a62-f308b48087da tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006832 Jul 14 10:21:28.181705 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 417/823] 10.222.0.61 () {58 vars in 1139 bytes} [Thu Jul 14 10:21:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 10:21:28.187393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-000789fe-0b8e-4566-bbcb-d46e8459aae0 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004349 Jul 14 10:21:28.196164 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 418/824] 10.222.0.61 () {58 vars in 1136 bytes} [Thu Jul 14 10:21:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 10:21:28.202635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-68344878-d417-41da-ad06-2ce40a6a843e tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Calling method '.version_select at 0x7f5625830160>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:28.234495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-68344878-d417-41da-ad06-2ce40a6a843e tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] HTTP exception thrown: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-68344878-d417-41da-ad06-2ce40a6a843e tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Request method failure captured: Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/os-volumes/44e496b0-7da1-440d-be76-61b27f4d2ac8 HTTP/1.1 Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-4nVx3TVMmUkh3QaNW9ezPKRTnHDiobR6GzhOFE9LByr1rEu4o3X0znwj6xiIsH8iojx9odiPsqWub3cZE9n9-9wgz3t5ZT1a1vw7t3baWtZG3qpqwIbrUc7yqenaJ5XKSiaVLbGGMi0yeY7whyVWvrR3OletzNHWKhSHqiYmTF6To Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:28.236439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2e6d00592a534987ad4e2e4a5062b599", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bbfe723698da479f99fc508137a3c9a3 Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '44e496b0-7da1-440d-be76-61b27f4d2ac8'} Jul 14 10:21:28.237815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. (HTTP 404) (Request-ID: req-ed000f4e-edf3-4354-a5f7-853f4cabf31c) Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.238644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 10:21:28.239879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 10:21:28.241044 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-68344878-d417-41da-ad06-2ce40a6a843e tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Returning 404 to user: Volume 44e496b0-7da1-440d-be76-61b27f4d2ac8 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:28.242180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-68344878-d417-41da-ad06-2ce40a6a843e tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/44e496b0-7da1-440d-be76-61b27f4d2ac8" status: 404 len: 109 microversion: 2.1 time: 0.040371 Jul 14 10:21:28.245228 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 419/825] 10.222.0.61 () {58 vars in 1247 bytes} [Thu Jul 14 10:21:28 2022] DELETE /compute/v2.1/os-volumes/44e496b0-7da1-440d-be76-61b27f4d2ac8 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:28.254919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-22be6d88-378c-454b-a84f-d87d32b31779 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Calling method '.version_select at 0x7f5625841550>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:28.288887 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-22be6d88-378c-454b-a84f-d87d32b31779 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] HTTP exception thrown: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-22be6d88-378c-454b-a84f-d87d32b31779 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Request method failure captured: Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/os-volumes/df306543-6f61-448f-819d-7de487070f76 HTTP/1.1 Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-4nVx3TVMmUkh3QaNW9ezPKRTnHDiobR6GzhOFE9LByr1rEu4o3X0znwj6xiIsH8iojx9odiPsqWub3cZE9n9-9wgz3t5ZT1a1vw7t3baWtZG3qpqwIbrUc7yqenaJ5XKSiaVLbGGMi0yeY7whyVWvrR3OletzNHWKhSHqiYmTF6To Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:21:28.290946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2e6d00592a534987ad4e2e4a5062b599", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2e6d00592a534987ad4e2e4a5062b599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 2e6d00592a534987ad4e2e4a5062b599 Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-VolumesNegativeTest-1638050293 Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: bbfe723698da479f99fc508137a3c9a3 Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-VolumesNegativeTest-1638050293-project Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'df306543-6f61-448f-819d-7de487070f76'} Jul 14 10:21:28.292397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. (HTTP 404) (Request-ID: req-ac36f470-042d-4e15-870d-187a0e9fe627) Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.293265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 10:21:28.294411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 10:21:28.295563 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-22be6d88-378c-454b-a84f-d87d32b31779 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] Returning 404 to user: Volume df306543-6f61-448f-819d-7de487070f76 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:21:28.296862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-22be6d88-378c-454b-a84f-d87d32b31779 tempest-VolumesNegativeTest-1638050293 tempest-VolumesNegativeTest-1638050293-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/df306543-6f61-448f-819d-7de487070f76" status: 404 len: 109 microversion: 2.1 time: 0.046885 Jul 14 10:21:28.303116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 420/826] 10.222.0.61 () {58 vars in 1244 bytes} [Thu Jul 14 10:21:28 2022] GET /compute/v2.1/os-volumes/df306543-6f61-448f-819d-7de487070f76 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:21:28.314957 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:28.324395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:28.326274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:28.327661 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9b28658f-caad-45e8-810e-b780927822f0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.261454 Jul 14 10:21:28.342519 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 407/827] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:28 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:29.351646 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:29.352296 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:29.359766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:29.360647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:29.362585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:29.363234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:29.576051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:29.591575 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:29.593553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:29.596456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-751c45ad-cc47-4b69-956b-1928bf1b786b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.249827 Jul 14 10:21:29.597619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 421/828] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:29 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:30.620734 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:30.622631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:30.661242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:30.661843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:30.662681 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:30.663204 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:30.841895 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:30.858510 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:30.860180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:30.861484 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-219fc496-f56b-4687-b0b9-4b9881e27612 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.248991 Jul 14 10:21:30.862718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 408/829] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:30 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:31.881807 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:31.883138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:31.890344 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:31.891045 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:31.892019 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:31.892944 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:32.046056 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:32.055369 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:32.057249 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:32.059517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8968231e-0504-4c33-a02c-ba00499aa4f5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1739 microversion: 2.20 time: 0.181705 Jul 14 10:21:32.060339 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 422/830] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:31 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:33.078572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:33.079173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:33.085732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:33.086186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:33.086942 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:33.087376 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:33.318097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:33.326092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:33.327566 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:33.328722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2be972aa-d5d2-4750-91ed-fbe62744240c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1721 microversion: 2.20 time: 0.254046 Jul 14 10:21:33.329311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 409/831] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:33 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:34.347139 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:34.347754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:34.354180 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:34.354625 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:34.356116 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:34.356551 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:34.482526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:34.490380 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:34.491883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:34.493046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e6182281-4770-4861-a607-18c421d0ff34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1721 microversion: 2.20 time: 0.149750 Jul 14 10:21:34.493603 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 423/832] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:34 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:35.512426 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:35.513156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:35.520272 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:35.521076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:35.521981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:35.522417 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:35.662055 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:35.669911 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:35.671418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:35.672591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2b815b64-b4cf-4d1e-a456-9f45885e51c1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1724 microversion: 2.20 time: 0.164867 Jul 14 10:21:35.673169 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 410/833] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:35 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:35.690134 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e1be1ee-f536-4999-b6fe-e41884cccb48"}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:35.691253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:35.697753 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:35.698199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:35.699452 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:35.699982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:35.985820 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9ce396b8-e707-4e22-beab-54d676633e3a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299627 Jul 14 10:21:35.986430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 424/834] 10.222.0.61 () {62 vars in 1363 bytes} [Thu Jul 14 10:21:35 2022] POST /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 10:21:36.102170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:36.102820 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:36.109492 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:36.109950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:36.110718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:36.111160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:36.190553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9def7a3e-c8dd-463e-9c60-f59981831178 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/action" status: 202 len: 0 microversion: 2.20 time: 0.092383 Jul 14 10:21:36.191156 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 411/835] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jul 14 10:21:36 2022] POST /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:21:36.199746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:36.200368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:36.206975 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:36.207433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:36.208209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:36.208654 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:36.340674 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:36.349261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:36.350644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:36.351837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ec8c327f-5e24-49e6-b88f-d4d1e08408e7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1750 microversion: 2.20 time: 0.156481 Jul 14 10:21:36.352390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 425/836] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:36 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:37.370738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:37.371599 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:37.377648 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:37.378099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:37.378872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:37.379313 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:37.510948 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:37.519743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:37.521299 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:37.522452 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b81dda1a-a0f2-42c4-8ec0-985881d7f932 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1752 microversion: 2.20 time: 0.156102 Jul 14 10:21:37.523012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 412/837] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:37 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:38.541898 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:38.544382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:38.550598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:38.551231 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:38.552119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:38.552652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:38.627151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-1f8aee89-0b21-4b40-ae3d-ef495da6c585 req-77c709ce-1806-4f17-8d38-a47e4af5bf2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "name": "network-vif-unplugged", "status": "completed", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:21:38.637822 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-1f8aee89-0b21-4b40-ae3d-ef495da6c585 req-77c709ce-1806-4f17-8d38-a47e4af5bf2e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:38.638398 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-1f8aee89-0b21-4b40-ae3d-ef495da6c585 req-77c709ce-1806-4f17-8d38-a47e4af5bf2e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:38.650113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-1f8aee89-0b21-4b40-ae3d-ef495da6c585 req-77c709ce-1806-4f17-8d38-a47e4af5bf2e service nova] Creating event network-vif-unplugged:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:21:38.655339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-1f8aee89-0b21-4b40-ae3d-ef495da6c585 req-77c709ce-1806-4f17-8d38-a47e4af5bf2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031980 Jul 14 10:21:38.656052 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 413/838] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:21:38.768918 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:38.778375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:38.779901 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:38.781105 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a08d969c-b9f0-4fb6-b518-8514ac6ad794 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.243260 Jul 14 10:21:38.781673 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 426/839] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:38 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:39.800102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:39.801462 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:39.809205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:39.810012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:39.810913 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:39.811544 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:39.980160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:39.989971 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:39.992339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:39.993814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1b87b687-7a0c-47f9-857a-662aa67cb4d4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.198539 Jul 14 10:21:39.995180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 414/840] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:39 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:41.013795 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:41.014613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:41.023252 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:41.024145 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:41.025029 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:41.025554 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:41.156342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:41.164752 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:41.166300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:41.168106 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1d0d71ca-7a9c-4be4-9850-f01dadfb3821 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.158124 Jul 14 10:21:41.168691 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 427/841] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:41 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:42.186763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:42.187389 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:42.193653 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:42.194102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:42.194859 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:42.195293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:42.324615 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:42.332876 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:42.334400 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:42.335552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-4057b4e8-9359-43de-bfa4-776111f2e0a5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.153171 Jul 14 10:21:42.336112 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 415/842] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:42 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:43.353762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:43.354487 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:43.361175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:43.361629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:43.362392 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:43.362834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:43.520318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:43.530884 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:43.532942 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:43.534984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5297f7ca-484b-44ad-9b14-cc2f6f3124b2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.184345 Jul 14 10:21:43.534984 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 428/843] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:43 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:44.552335 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:44.553718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:44.561584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:44.562405 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:44.563292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:44.563940 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:44.850021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:44.858353 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:44.859888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:44.861085 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2a7a7060-6bfd-4212-9807-723f1146dd85 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.313017 Jul 14 10:21:44.861652 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 416/844] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:44 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:45.879656 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:45.880265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:45.886947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:45.887402 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:45.888170 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:45.888614 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:45.891292 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:46.025127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:46.033933 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:46.035532 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:46.036722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b54689e9-51c6-42cf-83ec-63dee17feff1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.160993 Jul 14 10:21:46.037379 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 429/845] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:45 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:21:47.056014 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:47.056630 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:47.064350 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:47.064811 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:47.065611 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:47.066056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:47.210588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:47.223117 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:47.225810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:47.227390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7c327d2c-b799-4746-80d2-16f73a2a4bb0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.175375 Jul 14 10:21:47.228820 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 417/846] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:47 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:48.250854 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:48.252364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:48.261318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:48.262231 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:48.263376 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:48.263976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:48.777013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:48.791184 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:48.800998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:48.802946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-136492b6-78d6-4f05-956c-73ecced09fee tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.560384 Jul 14 10:21:48.806168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 430/847] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:48 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:49.824479 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:49.825253 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:49.832739 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:49.833406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:49.834307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:49.834760 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:49.839659 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:49.987833 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:49.997769 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:49.999285 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:50.000441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ad4931e1-a390-41a2-9b05-8f22b8fd24e8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.181690 Jul 14 10:21:50.012209 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 418/848] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:49 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:51.019734 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:51.021281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:51.031358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:51.033310 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:51.034113 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:51.034585 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:51.232744 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:51.254047 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:51.255899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:51.260811 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-16d84b13-0601-4d77-9ebf-479c687ded46 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.244643 Jul 14 10:21:51.261850 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 431/849] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:51 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:52.280005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:52.281476 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:52.289180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:52.289740 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:52.290910 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:52.292068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:52.485412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:52.493950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:52.495569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:52.496729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a2d90fb6-5bac-4448-bf47-14fc0d98fb1b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.220724 Jul 14 10:21:52.497494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 419/850] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:52 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:53.515192 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:53.515808 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:53.522467 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:53.522922 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:53.523703 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:53.524148 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:53.658423 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:53.667548 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:53.669088 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:53.670236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-df1c0a57-7d27-4388-8009-092bd553bebf tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.158897 Jul 14 10:21:53.670787 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 432/851] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:53 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:54.688470 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:54.689037 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:54.691513 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=32 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:54.697076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:54.698107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:54.698873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:54.699311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:54.838875 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:54.847747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:54.849323 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:54.850497 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e7144ca2-9de4-4185-b779-bf352eeec172 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.166042 Jul 14 10:21:54.851057 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 420/852] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:54 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:55.869869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:55.870524 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:55.872837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=30 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:21:55.878455 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:55.878940 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:55.879710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:55.880150 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:56.012005 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:56.021380 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:56.023053 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:56.024331 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b57ef731-c91a-4f6c-bb84-01b61d898130 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.159010 Jul 14 10:21:56.025137 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 433/853] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:55 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:57.044180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:57.044818 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:57.051366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:57.051810 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:57.052571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:57.053038 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:57.188176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:57.197143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:57.199333 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:57.200657 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f56337d6-e723-4654-aa56-ca4e396087e1 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.160999 Jul 14 10:21:57.201352 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 421/854] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:57 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:58.218704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:58.219301 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:58.226781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:58.227225 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:58.231738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:58.237146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:58.473481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:58.486426 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:58.488590 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:58.490177 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-67e8249e-1cdc-4ef2-a0ee-05e972608147 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1808 microversion: 2.20 time: 0.275252 Jul 14 10:21:58.490836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 434/855] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:58 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:21:59.512768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:21:59.513969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:21:59.521338 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:59.521792 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:59.522570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:21:59.523007 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:21:59.661676 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:59.670915 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:59.675631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:21:59.675631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d1fe5140-c252-4eb5-b51a-057019c39d24 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1795 microversion: 2.20 time: 0.168737 Jul 14 10:21:59.675631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 422/856] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:21:59 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1795 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:00.750214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-a0168389-8cd1-4021-bda0-98f8e5e24ef0 req-7a52cdc2-6cd5-4089-bab3-6b8305a7e2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "name": "network-vif-plugged", "status": "completed", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:00.758953 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a0168389-8cd1-4021-bda0-98f8e5e24ef0 req-7a52cdc2-6cd5-4089-bab3-6b8305a7e2bb service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:00.759398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a0168389-8cd1-4021-bda0-98f8e5e24ef0 req-7a52cdc2-6cd5-4089-bab3-6b8305a7e2bb service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:00.771539 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-a0168389-8cd1-4021-bda0-98f8e5e24ef0 req-7a52cdc2-6cd5-4089-bab3-6b8305a7e2bb service nova] Creating event network-vif-plugged:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:22:00.776952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-a0168389-8cd1-4021-bda0-98f8e5e24ef0 req-7a52cdc2-6cd5-4089-bab3-6b8305a7e2bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030388 Jul 14 10:22:00.777558 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 435/857] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:23.474169 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d9346481-8edb-4d9d-817f-4d1dea98ed69 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Action: 'create', calling method: .version_select at 0x7f5625830d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-304069724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0QjB9Y/6skw7RiXTHxKWytkHs+eDdJR1C4oJC/Ne8HDuxWOw5S1haNuee60xe8SO6JDRnB7b1hW0uomrUKljgUCoD2djDuBXbZ97zOH7BJWz9I68WmXVOSJR/eB1S17Q=="}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:23.478727 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=5 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:23.479381 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=29 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:23.491457 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-d9346481-8edb-4d9d-817f-4d1dea98ed69 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Getting quotas for project 936db5c6e71f4012a4838d484c1ca92e. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:22:23.495988 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-d9346481-8edb-4d9d-817f-4d1dea98ed69 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Getting quotas for user 1c009a915aad4fe9b8c334e64ecb2e48 and project 936db5c6e71f4012a4838d484c1ca92e. Resources: {'key_pairs'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:22:23.520767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d9346481-8edb-4d9d-817f-4d1dea98ed69 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050557 Jul 14 10:22:23.521488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 423/858] 10.222.0.61 () {60 vars in 1158 bytes} [Thu Jul 14 10:22:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:23.575805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=5 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:23.576955 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=37 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:23.582150 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1794657475", "imageRef": "d580b1eb-7168-4076-a68d-80dbc27db405", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-304069724", "networks": [{"uuid": "4a81396c-241f-47b0-9c22-fb5e497d7444"}]}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:23.633049 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] validate_networks() for [('4a81396c-241f-47b0-9c22-fb5e497d7444', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:22:24.007096 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:22:24.007537 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:22:24.008009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:22:24.008411 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:22:24.008818 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:22:24.017888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:24.018275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:24.019058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:24.019490 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:24.036704 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Getting quotas for project 936db5c6e71f4012a4838d484c1ca92e. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:22:24.041254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Getting quotas for user 1c009a915aad4fe9b8c334e64ecb2e48 and project 936db5c6e71f4012a4838d484c1ca92e. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:22:24.051959 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:22:24.054219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d580b1eb-7168-4076-a68d-80dbc27db405',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:22:24.097735 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6e975809-71b3-4856-96ba-16cacbfaf5c9 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523456 Jul 14 10:22:24.098597 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 436/859] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:22:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:22:24.109146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d4f88ebb-f0cf-4a65-8569-345cbe8072a8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:24.109753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d4f88ebb-f0cf-4a65-8569-345cbe8072a8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:24.167408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d4f88ebb-f0cf-4a65-8569-345cbe8072a8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:24.174348 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d4f88ebb-f0cf-4a65-8569-345cbe8072a8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1258 microversion: 2.1 time: 0.069034 Jul 14 10:22:24.175119 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 424/860] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:24 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:25.192773 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:25.193619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:25.201025 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:25.201621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:25.202471 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:25.203159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:25.579748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:25.589281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5c339f89-2a2e-4a53-8c6b-426f59504e17 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1328 microversion: 2.1 time: 0.401252 Jul 14 10:22:25.591146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 437/861] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:25 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1328 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:26.610206 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:26.612012 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:26.620943 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:26.621561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:26.622726 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:26.623324 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:26.810969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:26.818418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d9916695-8823-4c28-90ca-dfcb419d40f3 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.213048 Jul 14 10:22:26.819503 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 425/862] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:26 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:27.835540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:27.836149 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:27.843205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:27.843658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:27.844414 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:27.844852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:28.004002 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:28.021828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-974d030b-f0cd-42b7-8c04-9a2b9b649782 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.190006 Jul 14 10:22:28.023119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 438/863] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:27 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:29.041834 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:29.043252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:29.056107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:29.057195 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:29.058754 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:29.059749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:29.263846 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:29.271624 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d974d3db-3dfc-499f-9c89-f7dcf7c69e22 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.235850 Jul 14 10:22:29.278631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 426/864] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:29 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:30.296104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:30.298259 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:30.308446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:30.309018 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:30.310481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:30.311260 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:30.483457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:30.491922 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e3a12787-1f95-49c0-ae24-7984310b8b6b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.200440 Jul 14 10:22:30.492513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 439/865] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:30 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:31.510385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:31.510972 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:31.518154 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:31.518796 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:31.519839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:31.520347 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:31.658914 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:31.667997 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c633535e-29b2-4e70-ac1f-aea8dce94c02 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.162025 Jul 14 10:22:31.668638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 427/866] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:31 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:32.684838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:32.685555 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:32.692115 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:32.692586 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:32.693400 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:32.693836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:32.834181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:32.853187 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d4f00c3e-abd8-4ab9-b599-ba1d5cbd1c14 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.171318 Jul 14 10:22:32.853884 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 440/867] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:32 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:33.871160 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:33.871848 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:33.878486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:33.878938 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:33.879705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:33.880150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:34.126853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:34.134316 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7b772118-82c4-445c-8fe1-b21d20620c03 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.267691 Jul 14 10:22:34.134886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 428/868] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:33 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:34.486899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-bcf7387a-3901-4442-a152-08795770edd6 req-8ffec4db-933b-4e07-a632-de60fb4794c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:34.497538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=2 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:34.498505 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=6 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:34.501864 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-bcf7387a-3901-4442-a152-08795770edd6 req-8ffec4db-933b-4e07-a632-de60fb4794c6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:34.502395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-bcf7387a-3901-4442-a152-08795770edd6 req-8ffec4db-933b-4e07-a632-de60fb4794c6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:34.516776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-bcf7387a-3901-4442-a152-08795770edd6 req-8ffec4db-933b-4e07-a632-de60fb4794c6 service nova] Creating event network-changed:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:22:34.521775 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-bcf7387a-3901-4442-a152-08795770edd6 req-8ffec4db-933b-4e07-a632-de60fb4794c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039103 Jul 14 10:22:34.522323 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 441/869] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:35.151325 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:35.151938 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:35.153837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=6 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:35.160006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:35.160463 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:35.161268 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:35.161706 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:35.289392 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:35.296794 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d0ee81cb-99d4-4cf7-b548-f9ceca285032 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.149407 Jul 14 10:22:35.297386 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 429/870] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:35 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:36.315435 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:36.316136 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:36.322326 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:36.322780 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:36.323542 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:36.323985 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:36.458109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:36.465595 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c0f1ec67-7148-44d3-8c37-3980f6899474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.154961 Jul 14 10:22:36.466159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 442/871] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:36 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:37.481837 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:37.482383 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:37.488856 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:37.489342 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:37.490270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:37.490717 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:37.651924 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:37.659451 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-edd88ca3-6c38-4d8e-9e47-816f1092263c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.181581 Jul 14 10:22:37.660025 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 430/872] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:37 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:38.323568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:38.324070 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:38.330562 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.331017 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.331789 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.332229 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.362621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-5ae70aa5-667d-436d-8cea-8a8b02185fdd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments/7e1be1ee-f536-4999-b6fe-e41884cccb48" status: 200 len: 194 microversion: 2.20 time: 0.043070 Jul 14 10:22:38.363194 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 443/873] 10.222.0.61 () {60 vars in 1453 bytes} [Thu Jul 14 10:22:38 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments/7e1be1ee-f536-4999-b6fe-e41884cccb48 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:22:38.426089 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:38.426589 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:38.433745 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.434205 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.434974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.435417 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.515507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lazy-loading 'services' on Instance uuid 3a1ec4c5-369c-4368-aa74-03211ceea168 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:22:38.585863 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-177e58b2-d651-4b71-94f2-b05f3b7a7c09 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments/7e1be1ee-f536-4999-b6fe-e41884cccb48" status: 202 len: 0 microversion: 2.20 time: 0.163513 Jul 14 10:22:38.587104 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 431/874] 10.222.0.61 () {60 vars in 1456 bytes} [Thu Jul 14 10:22:38 2022] DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments/7e1be1ee-f536-4999-b6fe-e41884cccb48 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:22:38.595441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:38.596416 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:38.602607 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.603099 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.603901 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.604343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.635493 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c060985b-9c42-4f76-b1d5-700e5de77557 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043974 Jul 14 10:22:38.636080 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 444/875] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Jul 14 10:22:38 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:22:38.677211 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:38.677914 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:38.684522 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.685000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.685774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.686312 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.821627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:38.829170 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-93bc7c45-65b7-4a1e-95ec-5991dfb85556 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.156186 Jul 14 10:22:38.829732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 432/876] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:38 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:38.963295 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-536c6011-28b0-42f1-a6ba-43c98e793e8d req-e209e92b-54fd-4394-a86a-1926cb1d610a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "name": "network-vif-plugged", "status": "completed", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:38.971629 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-536c6011-28b0-42f1-a6ba-43c98e793e8d req-e209e92b-54fd-4394-a86a-1926cb1d610a service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:38.972011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-536c6011-28b0-42f1-a6ba-43c98e793e8d req-e209e92b-54fd-4394-a86a-1926cb1d610a service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:38.983580 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-536c6011-28b0-42f1-a6ba-43c98e793e8d req-e209e92b-54fd-4394-a86a-1926cb1d610a service nova] Creating event network-vif-plugged:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:22:38.988326 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-536c6011-28b0-42f1-a6ba-43c98e793e8d req-e209e92b-54fd-4394-a86a-1926cb1d610a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028794 Jul 14 10:22:38.988919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 445/877] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:39.646725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:39.647669 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:39.654666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.655121 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.655892 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.656327 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.685086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-75067b35-56db-4eb3-a520-78930049c2bb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042362 Jul 14 10:22:39.685627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 433/878] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Jul 14 10:22:39 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:22:39.742481 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:39.743119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:39.749538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.749993 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.750764 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.751239 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.776256 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:22:39.846173 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:39.846751 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:39.849684 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-66d4db12-2ae7-45b8-a788-f1e869d67072 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 204 len: 0 microversion: 2.20 time: 0.111640 Jul 14 10:22:39.850299 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 446/879] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jul 14 10:22:39 2022] DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:22:39.856632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.857122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.857891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.858334 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.859230 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:39.859964 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:39.865999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.866456 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:39.867226 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:39.867834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:40.059319 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:40.063361 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:40.066722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a3cbee20-0a1d-4f5a-8f06-e9b800e36885 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.224455 Jul 14 10:22:40.067303 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 434/880] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:39 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:22:40.071464 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:40.073108 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:40.074345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-cea213c3-6c30-44c0-9b7b-5f3ef742a376 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.219148 Jul 14 10:22:40.074957 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 447/881] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:39 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:22:41.083134 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:41.083750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:41.090395 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:41.090853 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:41.091626 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:41.092067 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:41.092667 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:41.093297 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:41.100076 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:41.100530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:41.101457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:41.102015 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:41.287151 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:41.291149 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:41.294870 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0f88e332-e332-41e6-ac93-04dc744dd7bd tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1358 microversion: 2.1 time: 0.215562 Jul 14 10:22:41.295525 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 435/882] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:41 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:41.299057 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:41.300560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:41.301737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-60c08c79-bf74-47e6-b4d0-c93e03c304e2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.212914 Jul 14 10:22:41.302308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 448/883] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:41 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:22:42.312418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:42.314497 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:42.319446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:42.319946 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.320360 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:42.320618 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.321424 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.321868 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.327641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.328176 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.329051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.329560 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.603521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:42.611002 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d35a38e7-bd87-4870-aa13-74fbd01a3469 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1548 microversion: 2.1 time: 0.302728 Jul 14 10:22:42.611569 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 436/884] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:42 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1548 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:42.628878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:42.629582 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:42.632528 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:42.636437 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.636883 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.637908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.638345 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.641759 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:42.643276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:42.644446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-332af207-b1d5-4d5b-b205-94ed854b318a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 200 len: 1723 microversion: 2.20 time: 0.328814 Jul 14 10:22:42.652459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 449/885] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:42 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:22:42.886473 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:42.894318 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e2bb6510-33f1-4c69-ae0c-c5f6fb0c8145 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1548 microversion: 2.1 time: 0.269369 Jul 14 10:22:42.894885 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 437/886] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:42 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:42.909905 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:42.913375 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:42.914655 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Searching by: {'deleted': False, 'project_id': '936db5c6e71f4012a4838d484c1ca92e'} {{(pid=117809) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 10:22:42.921696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.922150 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:42.922955 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:42.923396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:43.015814 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.multi_cell_list [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117809) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 10:22:43.119802 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f4bd338e-b4fa-4bee-88be-0c153ac40148 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213592 Jul 14 10:22:43.120400 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 450/887] 10.222.0.61 () {58 vars in 1124 bytes} [Thu Jul 14 10:22:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:22:43.133637 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:43.134599 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:43.141954 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:43.142719 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:43.143512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:43.143981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:43.368209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-f56d5082-57bd-4cc6-9487-6fd9f6d845a6 req-e84d2df1-22b8-44c5-9603-668ac05dc3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1ec4c5-369c-4368-aa74-03211ceea168", "name": "network-vif-deleted", "tag": "8ba13434-52d7-4813-b0c6-beeb755f6fda"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:43.378946 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-f56d5082-57bd-4cc6-9487-6fd9f6d845a6 req-e84d2df1-22b8-44c5-9603-668ac05dc3d9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:43.379391 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-f56d5082-57bd-4cc6-9487-6fd9f6d845a6 req-e84d2df1-22b8-44c5-9603-668ac05dc3d9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:43.392504 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-f56d5082-57bd-4cc6-9487-6fd9f6d845a6 req-e84d2df1-22b8-44c5-9603-668ac05dc3d9 service nova] Creating event network-vif-deleted:8ba13434-52d7-4813-b0c6-beeb755f6fda for instance 3a1ec4c5-369c-4368-aa74-03211ceea168 on hv-cinder-84980 Jul 14 10:22:43.399036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-f56d5082-57bd-4cc6-9487-6fd9f6d845a6 req-e84d2df1-22b8-44c5-9603-668ac05dc3d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Jul 14 10:22:43.400774 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 451/888] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:22:43.448622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:43.457456 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-359c56cd-633b-4977-9a73-def4690690cb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1548 microversion: 2.1 time: 0.329245 Jul 14 10:22:43.458045 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 438/889] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:43 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1548 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:43.663643 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:43.665498 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:43.672246 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:43.672767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:43.673598 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:43.674039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:43.692300 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] HTTP exception thrown: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Request method failure captured: Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 HTTP/1.1 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-3StXhBjDqCR22P4lkix2HrCXW5G2YBPicqUvD8PwfSS975dnEyQAN-MSMvgc3Qcigy1CvDGgzbNsDhVPBn8FavCH7_c8nX_ZqcKxRBPqSniuVHdsx3M8GYm-0jvMbEMTll_Zol7AcKUZx4uufjXqe9k2frFyrQLgiCe7cIIU3DuPU Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:22:43.694067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4f945783031448849dc0e5a3337f8c76", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 7b0f433eba57485cbbfeab651a8e8b02 Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:22:43.696943 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '3a1ec4c5-369c-4368-aa74-03211ceea168'} Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:22:43.698101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:22:43.700459 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:22:43.702275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Returning 404 to user: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:22:43.702275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-547e01e0-efa7-43d9-8711-59b4c44733d7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 404 len: 111 microversion: 2.20 time: 0.036330 Jul 14 10:22:43.702275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 452/890] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:43 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:22:43.706676 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2c4099bf-8a95-4410-80b6-8536ff66ae2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '.version_select at 0x7f56257d0ca0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:43.725328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2c4099bf-8a95-4410-80b6-8536ff66ae2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-670224282" status: 204 len: 0 microversion: 2.20 time: 0.023294 Jul 14 10:22:43.726603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 439/891] 10.222.0.61 () {60 vars in 1258 bytes} [Thu Jul 14 10:22:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-670224282 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 10:22:44.396277 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ff771fd3-2aed-421a-80ac-170a1b7169fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'create', calling method: .version_select at 0x7f5625841430>, body: {"keypair": {"name": "tempest-keypair-440503830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/7JIJT+UnFU84fjb0qlIoLESW2iF1327HDplaByi2ujcGePA5BYTpoFpwTR4CJ6jv2p8Ybc7YpDevxR+aMbN0/JEYjVXsPYWx37e+5+86qBws/JcEZarfHBSqWA5apTQ=="}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:44.410333 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-ff771fd3-2aed-421a-80ac-170a1b7169fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for project 4f945783031448849dc0e5a3337f8c76. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:22:44.569276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-ff771fd3-2aed-421a-80ac-170a1b7169fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for user 7b0f433eba57485cbbfeab651a8e8b02 and project 4f945783031448849dc0e5a3337f8c76. Resources: {'key_pairs'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:22:44.591762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ff771fd3-2aed-421a-80ac-170a1b7169fa tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.199416 Jul 14 10:22:44.592362 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 453/892] 10.222.0.61 () {62 vars in 1199 bytes} [Thu Jul 14 10:22:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 10:22:45.040693 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6a02af8-18f3-41b7-b283-9c0af483aee5"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:45.041879 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:45.049097 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:45.049797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:45.050572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:45.051008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:45.284022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:45.301612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-226d1c65-ddd6-4fa4-9fe5-f465461ebad1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265393 Jul 14 10:22:45.302239 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 440/893] 10.222.0.61 () {60 vars in 1322 bytes} [Thu Jul 14 10:22:45 2022] POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:45.891480 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-486253431", "imageRef": "032cfc63-270a-4d69-aaba-93308c9d1fb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b0d2893-bd16-48bf-a613-0a94b5150967"}], "security_groups": [{"name": "tempest-securitygroup--2129033426"}], "key_name": "tempest-keypair-440503830", "user_data": "}} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:46.006419 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.network.neutron [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] validate_networks() for [('9b0d2893-bd16-48bf-a613-0a94b5150967', None, None, None, None, None)] {{(pid=117809) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:22:46.384513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Flavor limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:22:46.386014 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Image limits 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:22:46.386820 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Flavor pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:22:46.387437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Image pref 0:0:0 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:22:46.388068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.virt.hardware [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:22:46.398398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:46.398864 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:46.399676 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:46.400119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:46.424875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for project 4f945783031448849dc0e5a3337f8c76. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:22:46.429328 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.quota [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Getting quotas for user 7b0f433eba57485cbbfeab651a8e8b02 and project 4f945783031448849dc0e5a3337f8c76. Resources: {'instances', 'ram', 'cores'} {{(pid=117809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:22:46.441785 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Going to run 1 instances... {{(pid=117809) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:22:46.444012 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='032cfc63-270a-4d69-aaba-93308c9d1fb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:22:46.496256 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9844b185-cf14-4cea-a8ad-c8ffe7f4ebba tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.608971 Jul 14 10:22:46.496900 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 454/894] 10.222.0.61 () {62 vars in 1187 bytes} [Thu Jul 14 10:22:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 10:22:46.511530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2833c437-f9c7-4db4-bbc3-77dc7d56bbed tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:46.513163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2833c437-f9c7-4db4-bbc3-77dc7d56bbed tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:46.571428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2833c437-f9c7-4db4-bbc3-77dc7d56bbed tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:46.579305 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2833c437-f9c7-4db4-bbc3-77dc7d56bbed tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:46.580881 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2833c437-f9c7-4db4-bbc3-77dc7d56bbed tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:46.582058 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2833c437-f9c7-4db4-bbc3-77dc7d56bbed tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1280 microversion: 2.20 time: 0.078074 Jul 14 10:22:46.582617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 441/895] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:46 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1280 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:47.600874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:47.602059 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:47.608261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:47.608714 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:47.609513 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:47.609972 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:47.628895 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:47.677298 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:47.685747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:47.687263 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:47.688363 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b9f8665b-bd1e-4619-a321-b03f26a50ea4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1284 microversion: 2.20 time: 0.091891 Jul 14 10:22:47.688911 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 455/896] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:47 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:48.706636 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:48.707243 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:48.714662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:48.715115 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:48.715874 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:48.716308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:48.775448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:48.783275 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:48.784792 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:48.785915 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-54a05c45-ba35-4678-8381-a3afa074faac tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1276 microversion: 2.20 time: 0.083189 Jul 14 10:22:48.786471 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 442/897] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:48 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:49.807170 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:49.808778 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:49.820242 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:49.821792 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:49.822912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:49.823578 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:49.944359 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:49.955724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:49.957948 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:49.959557 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c339e2e8-5475-4e18-a977-03b675710692 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1340 microversion: 2.20 time: 0.158755 Jul 14 10:22:49.960205 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 456/898] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:49 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1340 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:50.987150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:50.987995 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:50.994607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:50.995153 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:50.995918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:50.996356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:51.160505 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:51.170776 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:51.172292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:51.173450 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-de4f246f-1d96-4044-bc1d-f905488565d3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.190287 Jul 14 10:22:51.174011 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 443/899] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:50 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:51.315191 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-6fa62935-432f-4c21-b800-8582f06a574a req-4d7f3b4f-fd3e-4495-8d22-38a25b430ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:51.324708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6fa62935-432f-4c21-b800-8582f06a574a req-4d7f3b4f-fd3e-4495-8d22-38a25b430ab6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:51.325196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6fa62935-432f-4c21-b800-8582f06a574a req-4d7f3b4f-fd3e-4495-8d22-38a25b430ab6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:51.336815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-6fa62935-432f-4c21-b800-8582f06a574a req-4d7f3b4f-fd3e-4495-8d22-38a25b430ab6 service nova] Creating event network-changed:7394de63-0ffc-4bd9-89f0-6e8ea590a6c1 for instance baef7bfd-8592-43c5-af1f-637b8fe59249 on hv-cinder-84980 Jul 14 10:22:51.342241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-6fa62935-432f-4c21-b800-8582f06a574a req-4d7f3b4f-fd3e-4495-8d22-38a25b430ab6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032302 Jul 14 10:22:51.342834 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 457/900] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:52.191750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:52.192427 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:52.200999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:52.200999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:52.200999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:52.200999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:52.329872 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:52.338448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:52.339947 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:52.341079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b6590cff-40c4-4846-bf92-a094cd318808 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.153247 Jul 14 10:22:52.341638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 444/901] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:52 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:52.849774 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:52.850479 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:52.857166 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:52.857624 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:52.858387 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:52.858830 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:52.984406 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:52.993171 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-aa7408dc-93e0-445a-b65e-b4b2ad486c7b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1594 microversion: 2.1 time: 0.147477 Jul 14 10:22:52.993738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 458/902] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:52 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1594 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:53.347323 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1817198481", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2142394265", "security_groups": [{"name": "tempest-secgroup-smoke-957205412"}], "block_device_mapping_v2": [{"uuid": "2d0c336d-1b6f-49c8-9799-ab1428851838", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "6a5bd4dd-229b-4523-a623-35c0c9078f3c"}]}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:53.361315 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:53.362486 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:53.368667 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:53.369308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:53.370087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:53.370757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:53.576470 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.network.neutron [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] validate_networks() for [('6a5bd4dd-229b-4523-a623-35c0c9078f3c', None, None, None, None, None)] {{(pid=117810) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 10:22:53.631061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:53.640302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:53.642268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:53.643403 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-38cd4f63-20c4-4069-83b4-de27f97c7098 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.286074 Jul 14 10:22:53.643970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 459/903] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:53 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:22:53.906630 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:54.329493 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Flavor limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 10:22:54.329921 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Image limits 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 10:22:54.330402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Flavor pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 10:22:54.330814 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Image pref 0:0:0 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 10:22:54.331231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.virt.hardware [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 10:22:54.340118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:54.340572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:54.341412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:54.341857 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:54.361033 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 10:22:54.365019 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.quota [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Getting quotas for user 8cd8f0490c6949cbba431b0b317683fd and project f5484157d3894ec097d1f1b2e0bacc16. Resources: {'instances', 'ram', 'cores'} {{(pid=117810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 10:22:54.423681 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Going to run 1 instances... {{(pid=117810) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 10:22:54.425823 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2d0c336d-1b6f-49c8-9799-ab1428851838',volume_size=None,volume_type=None)] {{(pid=117810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 10:22:54.557619 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-31a3b146-65e3-491d-94ed-df918271d793 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.214567 Jul 14 10:22:54.558497 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 445/904] 10.222.0.61 () {60 vars in 1146 bytes} [Thu Jul 14 10:22:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 10:22:54.568275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d6443e48-0249-4810-ae36-c89575269df5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:54.569066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d6443e48-0249-4810-ae36-c89575269df5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:54.571670 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:54.661926 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:54.662530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:54.669635 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:54.670086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:54.670851 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:54.671287 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:54.705086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d6443e48-0249-4810-ae36-c89575269df5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:54.716202 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d6443e48-0249-4810-ae36-c89575269df5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1095 microversion: 2.1 time: 0.151299 Jul 14 10:22:54.717464 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 460/905] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:54 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1095 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:55.185771 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:55.193981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:55.196035 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:55.197187 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2c1df158-7283-4884-a9b3-c9acc58d292c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.539122 Jul 14 10:22:55.198076 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 446/906] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:54 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:22:55.552574 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-83e6772e-152f-4bc3-817c-339d513ff098 req-d1fed9aa-05e0-4632-8d7e-5d6b5bc94fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:55.563996 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-83e6772e-152f-4bc3-817c-339d513ff098 req-d1fed9aa-05e0-4632-8d7e-5d6b5bc94fb4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:55.564726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-83e6772e-152f-4bc3-817c-339d513ff098 req-d1fed9aa-05e0-4632-8d7e-5d6b5bc94fb4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:55.577004 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-83e6772e-152f-4bc3-817c-339d513ff098 req-d1fed9aa-05e0-4632-8d7e-5d6b5bc94fb4 service nova] Creating event network-changed:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:22:55.583100 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-83e6772e-152f-4bc3-817c-339d513ff098 req-d1fed9aa-05e0-4632-8d7e-5d6b5bc94fb4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034089 Jul 14 10:22:55.584622 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 461/907] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:55.734650 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:55.735942 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:55.749061 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:55.749712 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:55.750839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:55.752469 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:55.863797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:55.886603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9c573583-5fd0-452a-bd8e-cdb4fc2ae10f tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1211 microversion: 2.1 time: 0.156246 Jul 14 10:22:55.899152 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 447/908] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:55 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1211 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:22:56.217531 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:56.218322 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:56.232965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:56.236357 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:56.237553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:56.238211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:56.410277 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=4 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:22:56.565586 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:56.580083 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:56.581690 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:56.582847 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1377ee81-1c44-4154-aa14-ef5a57b273d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.370541 Jul 14 10:22:56.583781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 462/909] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:56 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:56.905447 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:56.906998 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:56.920167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:56.921079 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:56.922729 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:56.923808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.147886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:57.157397 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3bea4e35-c296-4ed2-8204-cc9be9bddb8c tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.256993 Jul 14 10:22:57.157974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 448/910] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:56 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:57.178273 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-7d43481d-7037-4595-a8fc-3c323dcc6700 req-f4a4a323-3f02-4881-9d07-87042837bac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "name": "network-vif-plugged", "status": "completed", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:57.188042 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7d43481d-7037-4595-a8fc-3c323dcc6700 req-f4a4a323-3f02-4881-9d07-87042837bac7 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:57.188635 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7d43481d-7037-4595-a8fc-3c323dcc6700 req-f4a4a323-3f02-4881-9d07-87042837bac7 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.204539 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-7d43481d-7037-4595-a8fc-3c323dcc6700 req-f4a4a323-3f02-4881-9d07-87042837bac7 service nova] Creating event network-vif-plugged:7394de63-0ffc-4bd9-89f0-6e8ea590a6c1 for instance baef7bfd-8592-43c5-af1f-637b8fe59249 on hv-cinder-84980 Jul 14 10:22:57.209864 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-7d43481d-7037-4595-a8fc-3c323dcc6700 req-f4a4a323-3f02-4881-9d07-87042837bac7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035492 Jul 14 10:22:57.210519 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 463/911] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:22:57.514523 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-905895090"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:57.515053 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:57.521518 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:57.521977 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.522761 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:57.523722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.603211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:57.604320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:57.615052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:57.615514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.616302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:57.616745 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.761835 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.network.security_group_api [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Adding security group 80b09934-2cb8-479e-9e1f-6b1c41f0a652 to port a4970b22-3386-4b5b-93b1-f2bb8380d732 Jul 14 10:22:57.917140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:57.926228 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:57.928249 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:57.929741 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-addfdb00-23f3-471b-8dd9-98e2a1e07e0d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.331417 Jul 14 10:22:57.930457 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 464/912] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:57 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:57.935337 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-2a57ac7d-5af0-4556-820a-f28ad5b40df7 req-2110839a-2818-4767-b866-03f0606a2217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a91a52d-5efe-404d-a6a4-8ece6166bfc6", "tag": "b386cc07-26ba-4101-8453-fa07ec85945c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:57.944041 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-2a57ac7d-5af0-4556-820a-f28ad5b40df7 req-2110839a-2818-4767-b866-03f0606a2217 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:57.944488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-2a57ac7d-5af0-4556-820a-f28ad5b40df7 req-2110839a-2818-4767-b866-03f0606a2217 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:57.956215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-2a57ac7d-5af0-4556-820a-f28ad5b40df7 req-2110839a-2818-4767-b866-03f0606a2217 service nova] Creating event network-changed:b386cc07-26ba-4101-8453-fa07ec85945c for instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 on hv-cinder-84980 Jul 14 10:22:57.961767 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-2a57ac7d-5af0-4556-820a-f28ad5b40df7 req-2110839a-2818-4767-b866-03f0606a2217 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029404 Jul 14 10:22:57.962623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 465/913] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:58.175367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:58.176079 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:58.182446 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.183127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:58.184101 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.184707 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:58.221666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-475a17d3-7adf-48b5-a2c4-10238acf4d50 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/action" status: 202 len: 0 microversion: 2.1 time: 0.711601 Jul 14 10:22:58.223342 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 449/914] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:22:57 2022] POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:22:58.231305 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:58.232114 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:58.256539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.257343 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:58.258969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.259553 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:58.463993 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:58.471772 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2d8ce58f-317f-4a46-b4e5-6f22cec0c287 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.300552 Jul 14 10:22:58.472803 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 466/915] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:58 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:22:58.481356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:58.489864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e1a93b13-e897-4e6d-8f79-43ecc65c21bf tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1758 microversion: 2.1 time: 0.262738 Jul 14 10:22:58.490384 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 450/916] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:58 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1758 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:22:58.504582 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-d58424ed-b484-42c1-9a4b-aa9524b65bfa req-6e59286d-ae43-4975-99cb-c1ed2da174bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:22:58.512653 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-d58424ed-b484-42c1-9a4b-aa9524b65bfa req-6e59286d-ae43-4975-99cb-c1ed2da174bf service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.513129 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-d58424ed-b484-42c1-9a4b-aa9524b65bfa req-6e59286d-ae43-4975-99cb-c1ed2da174bf service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:58.524782 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-d58424ed-b484-42c1-9a4b-aa9524b65bfa req-6e59286d-ae43-4975-99cb-c1ed2da174bf service nova] Creating event network-changed:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:22:58.529647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-d58424ed-b484-42c1-9a4b-aa9524b65bfa req-6e59286d-ae43-4975-99cb-c1ed2da174bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055043 Jul 14 10:22:58.530236 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 467/917] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:22:58.947841 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:58.948364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:58.954890 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.955344 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:58.956121 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:58.956562 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:59.087333 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:59.095214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:59.096767 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:59.097971 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9f9df028-96c8-4f1d-adc9-55916f0bfbcd tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1406 microversion: 2.20 time: 0.154263 Jul 14 10:22:59.098557 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 451/918] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:22:58 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:22:59.490099 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:22:59.490769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:22:59.497043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:59.497504 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:59.498274 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:22:59.498719 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:22:59.674269 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:22:59.682596 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2ecaf1b8-9a09-4429-b8a2-a0f0b7ce3cc9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.197243 Jul 14 10:22:59.689923 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 468/919] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:22:59 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:00.118397 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:00.119010 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:00.125579 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:00.126036 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:00.126808 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:00.127279 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:00.259975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:00.268085 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:00.269614 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:00.270829 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d8fa019d-ee0e-40b5-8dea-cc59f0b2c1ef tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1598 microversion: 2.20 time: 0.156548 Jul 14 10:23:00.271379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 452/920] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:00 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:00.288564 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:00.289133 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:00.295245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:00.295706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:00.296478 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:00.296973 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:00.373899 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-17ac1063-74a9-4c00-9860-cc2b1f32afd4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089131 Jul 14 10:23:00.374498 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 469/921] 10.222.0.61 () {60 vars in 1315 bytes} [Thu Jul 14 10:23:00 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:23:00.699999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:00.700609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:00.706645 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:00.707102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:00.707867 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:00.708304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:00.930488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:00.939016 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c14621e9-521d-4e4d-8ebc-0fc335251665 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.242797 Jul 14 10:23:00.939603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 453/922] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:00 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:01.369465 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-6ed006f7-d579-4331-afee-297bba3275dd req-1dca8626-474a-4d9c-b46f-c6c68cb710c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:01.377413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6ed006f7-d579-4331-afee-297bba3275dd req-1dca8626-474a-4d9c-b46f-c6c68cb710c9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:01.377856 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6ed006f7-d579-4331-afee-297bba3275dd req-1dca8626-474a-4d9c-b46f-c6c68cb710c9 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:01.390640 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-6ed006f7-d579-4331-afee-297bba3275dd req-1dca8626-474a-4d9c-b46f-c6c68cb710c9 service nova] Creating event network-changed:7394de63-0ffc-4bd9-89f0-6e8ea590a6c1 for instance baef7bfd-8592-43c5-af1f-637b8fe59249 on hv-cinder-84980 Jul 14 10:23:01.395626 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-6ed006f7-d579-4331-afee-297bba3275dd req-1dca8626-474a-4d9c-b46f-c6c68cb710c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030460 Jul 14 10:23:01.396469 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 470/923] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:23:01.955718 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:01.956328 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:01.963282 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:01.963741 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:01.964543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:01.965018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:02.113981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:02.122529 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ab9c87a9-f67e-4b96-afe0-2c4f7d07a0e8 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.170699 Jul 14 10:23:02.123115 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 454/924] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:01 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:03.140181 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:03.140809 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:03.147504 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:03.148465 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:03.149263 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:03.149709 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:03.279571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:03.287441 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-010ae971-bf59-4a13-a4d4-7aa24678f8a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.151796 Jul 14 10:23:03.288011 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 471/925] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:03 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:04.303950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:04.304559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:04.311132 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:04.311583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:04.312345 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:04.312784 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:04.348309 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=2 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:04.372143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell0:SELECT=8 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:04.446541 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:04.454053 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e2c2c52a-ac9a-4d9d-928d-09559f24d9b2 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.154146 Jul 14 10:23:04.454620 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 455/926] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:04 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:05.471683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:05.472282 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:05.474739 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell0:SELECT=12 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:05.480386 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:05.480839 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:05.481627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:05.482069 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:05.609662 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:05.617146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b694de5c-2850-46f5-a8a6-7ab19f60c154 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.149351 Jul 14 10:23:05.617706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 472/927] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:05 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:06.633628 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:06.634240 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:06.641180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:06.641631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:06.642396 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:06.642842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:06.771783 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:06.779963 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-9d79e3d6-72d4-4ce0-b39f-7f06aff9de8a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.150253 Jul 14 10:23:06.780528 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 456/928] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:06 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:07.797665 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:07.798452 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:07.805784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:07.806234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:07.806997 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:07.807437 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:07.939068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:07.946466 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e110f65e-f3da-4986-b45f-1791928ddee5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.153059 Jul 14 10:23:07.947030 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 473/929] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:07 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:08.964577 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:08.965216 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:08.971697 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:08.972148 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:08.972919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:08.973385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:09.104580 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:09.113118 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3c352861-1c34-425c-a362-deb78d682104 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.152980 Jul 14 10:23:09.113701 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 457/930] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:08 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:09.122385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-4cf3a85d-1da1-486c-8cc1-a1a62a3d43a1 req-7917c84c-b426-49ef-8768-1a00beac74a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a91a52d-5efe-404d-a6a4-8ece6166bfc6", "name": "network-vif-plugged", "status": "completed", "tag": "b386cc07-26ba-4101-8453-fa07ec85945c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:09.131314 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-4cf3a85d-1da1-486c-8cc1-a1a62a3d43a1 req-7917c84c-b426-49ef-8768-1a00beac74a4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:09.131757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-4cf3a85d-1da1-486c-8cc1-a1a62a3d43a1 req-7917c84c-b426-49ef-8768-1a00beac74a4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:09.143561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-4cf3a85d-1da1-486c-8cc1-a1a62a3d43a1 req-7917c84c-b426-49ef-8768-1a00beac74a4 service nova] Creating event network-vif-plugged:b386cc07-26ba-4101-8453-fa07ec85945c for instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 on hv-cinder-84980 Jul 14 10:23:09.148320 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-4cf3a85d-1da1-486c-8cc1-a1a62a3d43a1 req-7917c84c-b426-49ef-8768-1a00beac74a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029682 Jul 14 10:23:09.148949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 474/931] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:23:10.130797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:10.131423 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:10.138699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:10.139146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:10.147261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:10.148361 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:10.282906 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:10.290412 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-bdb6e191-5a8a-4b27-9968-90d6cbed85ec tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1266 microversion: 2.1 time: 0.163614 Jul 14 10:23:10.290979 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 458/932] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:10 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:11.309272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:11.310013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:11.316270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.316726 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.317526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.317970 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.448917 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:11.456951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-75929b4e-9102-4d0a-8f33-ac0d1f7f3762 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1453 microversion: 2.1 time: 0.152508 Jul 14 10:23:11.457519 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 475/933] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:11 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:11.473406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:11.474015 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:11.480518 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.480996 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.481766 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:11.482210 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:11.486207 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:11.612556 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:11.620104 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-061e4c7c-8d19-4c22-992e-3808eb6c49a1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1453 microversion: 2.1 time: 0.150480 Jul 14 10:23:11.620668 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 459/934] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:11 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:13.560449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-a0e56476-1723-4eae-8cbd-1c4c891a40ed req-c4f62141-624c-4030-b66d-fda4aa3b96d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a91a52d-5efe-404d-a6a4-8ece6166bfc6", "tag": "b386cc07-26ba-4101-8453-fa07ec85945c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:13.569272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a0e56476-1723-4eae-8cbd-1c4c891a40ed req-c4f62141-624c-4030-b66d-fda4aa3b96d5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:13.570530 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-a0e56476-1723-4eae-8cbd-1c4c891a40ed req-c4f62141-624c-4030-b66d-fda4aa3b96d5 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:13.581825 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-a0e56476-1723-4eae-8cbd-1c4c891a40ed req-c4f62141-624c-4030-b66d-fda4aa3b96d5 service nova] Creating event network-changed:b386cc07-26ba-4101-8453-fa07ec85945c for instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 on hv-cinder-84980 Jul 14 10:23:13.586881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-a0e56476-1723-4eae-8cbd-1c4c891a40ed req-c4f62141-624c-4030-b66d-fda4aa3b96d5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030305 Jul 14 10:23:13.587471 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 476/935] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:23:21.076449 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:21.077408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:21.084242 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:21.084738 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:21.085533 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:21.085980 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:21.172961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-156ee937-8f5c-4319-a81b-64f64ac4acc6 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/action" status: 202 len: 0 microversion: 2.1 time: 0.099684 Jul 14 10:23:21.173832 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 460/936] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:23:21 2022] POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:23:21.185893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:21.186724 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:21.195077 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:21.195652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:21.196544 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:21.197109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:21.202976 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=89 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:21.354766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:21.362935 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1ce3db41-609d-4a7d-96b3-6a9de834f7ed tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1750 microversion: 2.1 time: 0.184440 Jul 14 10:23:21.363517 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 477/937] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:21 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:22.382016 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:22.382727 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:22.389920 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:22.390379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:22.391145 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:22.391588 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:22.535849 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:22.544080 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-692f76c8-b9e2-45b3-b481-6b31370c02b1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.166954 Jul 14 10:23:22.544649 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 461/938] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:22 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:23.562999 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:23.563558 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:23.570747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:23.571196 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:23.571960 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:23.572394 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:23.715253 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:23.723306 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-8c81ae11-ed1e-46e8-a59b-8ad38bd07e12 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.164280 Jul 14 10:23:23.723860 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 478/939] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:23 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:24.741609 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:24.742203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:24.744715 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:24.750682 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:24.751130 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:24.751893 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:24.752322 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:24.901338 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:24.909542 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b470094c-bd27-41b5-8b86-d4cc972f11bb tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.172309 Jul 14 10:23:24.910163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 462/940] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:24 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:25.927275 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:25.927964 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:25.930273 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=40 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:25.936729 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:25.937221 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:25.938027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:25.938471 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:26.077954 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:26.086406 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ffc97c9c-7b0f-41f6-881f-78608287fb78 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.163016 Jul 14 10:23:26.087006 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 479/941] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:25 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:27.103949 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:27.104732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:27.111694 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:27.112143 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:27.112907 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:27.113372 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:27.258332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:27.266539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-bd9076e9-0cac-47d7-9b23-1101a973f861 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.166942 Jul 14 10:23:27.267094 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 463/942] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:27 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:28.284805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:28.285460 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:28.292529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:28.293020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:28.293812 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:28.294442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:28.435039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:28.442930 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ad88a689-475d-45ba-aa30-64d5f2947ff1 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.161992 Jul 14 10:23:28.443489 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 480/943] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:28 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:29.459905 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:29.460523 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:29.467153 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:29.467610 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:29.468382 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:29.468828 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:29.609167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:29.617781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-7f59f199-8ff4-4a8a-bc92-0577b979698b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.161785 Jul 14 10:23:29.618351 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 464/944] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:29 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:30.635609 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:30.636668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:30.643380 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:30.643836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:30.644604 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:30.645078 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:30.786672 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:30.794792 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d1d47742-e217-420e-b789-ee13e7e8700c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.163828 Jul 14 10:23:30.795354 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 481/945] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:30 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:31.812526 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:31.813172 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:31.819918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:31.820364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:31.821159 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:31.821595 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:31.962441 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:31.970357 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-43cbe2bb-1130-45de-a9d3-18ca82759cc0 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.161695 Jul 14 10:23:31.970919 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 465/946] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:31 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:32.987771 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:32.988398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:32.995533 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:32.995991 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:32.996756 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:32.997246 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:33.141185 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:33.150474 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e8b6f494-b0ca-4a0d-9c6d-3bce04c9999d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.166640 Jul 14 10:23:33.151061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 482/947] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:32 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:34.167760 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:34.168416 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:34.174975 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:34.175425 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:34.176194 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:34.176634 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:34.317665 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:34.325629 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-269f8ff7-d345-432f-b3f2-4a30f9f22378 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.161770 Jul 14 10:23:34.326193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 466/948] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:34 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:35.343367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:35.343919 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:35.350526 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:35.350986 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:35.351758 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:35.352204 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:35.499439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:35.507358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b7f9b441-11f7-4238-9df8-640f6f05f360 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.168106 Jul 14 10:23:35.507917 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 483/949] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:35 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:36.524584 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:36.525234 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:36.531725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:36.532187 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:36.532973 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:36.533418 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:36.674102 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:36.683515 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-c492c91b-3aff-4f47-b325-1beeff832665 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.163384 Jul 14 10:23:36.684087 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 467/950] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:36 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:23:37.701352 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:37.702112 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:37.708594 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:37.709072 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:37.709841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:37.710281 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:37.851062 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:37.858965 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e8e028f5-a2be-4232-995f-9b66b4e95474 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1755 microversion: 2.1 time: 0.161520 Jul 14 10:23:37.859528 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 484/951] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:37 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:38.876749 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:38.877394 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:38.884571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:38.885056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:38.885830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:38.886270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:39.029699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:39.037672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-491d9d28-3467-4105-994b-aefd5fc2555f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1758 microversion: 2.1 time: 0.164778 Jul 14 10:23:39.038240 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 468/952] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:23:38 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:23:44.821102 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:44.821685 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:44.828415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:44.828872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:44.829681 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:44.830126 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:44.853147 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-cfa87f3c-8425-4fa8-ad19-7382849b3b90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/ips" status: 200 len: 152 microversion: 2.20 time: 0.036603 Jul 14 10:23:44.853708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 485/953] 10.222.0.61 () {60 vars in 1288 bytes} [Thu Jul 14 10:23:44 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:23:46.635737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:23:46.636305 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:46.642766 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:46.643214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:46.643982 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:46.644417 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:46.646958 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:46.670236 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lazy-loading 'flavor' on Instance uuid baef7bfd-8592-43c5-af1f-637b8fe59249 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:23:46.955961 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-1978c9c2-9b45-47f3-a623-7165ecbebc42 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/action" status: 202 len: 0 microversion: 2.20 time: 0.324177 Jul 14 10:23:46.956704 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 469/954] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jul 14 10:23:46 2022] POST /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 10:23:46.965540 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:46.966182 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:46.972986 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:46.973600 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:46.974410 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:46.974880 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:47.238546 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:47.247710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:47.249265 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:47.250933 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-acd4badb-a6d6-408a-a330-56f6f771bd53 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.289031 Jul 14 10:23:47.251038 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 486/955] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:46 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:48.270081 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:48.271521 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:48.278482 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:48.278931 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:48.279698 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:48.280141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:48.461959 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:48.469970 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:48.471494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:48.472670 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fd899b56-1f2a-49f8-9183-cc1168febe0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.206921 Jul 14 10:23:48.473272 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 470/956] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:48 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:49.492863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:49.493499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:49.499994 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:49.500500 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:49.501260 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:49.501696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:49.634199 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:49.642442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:49.643957 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:49.645146 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b6ef96a1-b6d0-4866-8348-aeaf6feb59a9 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.156663 Jul 14 10:23:49.645747 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 487/957] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:49 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:50.664100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:50.664725 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:50.671307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:50.671763 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:50.672531 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:50.673022 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:50.804208 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:50.813041 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:50.814567 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:50.815737 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-014d0b44-f0cc-46de-916c-441068921689 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.156098 Jul 14 10:23:50.816308 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 471/958] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:50 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:51.834531 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:51.835140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:51.841631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:51.842082 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:51.842841 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:51.843277 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:51.847132 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=64 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:51.970619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:51.978473 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:51.979979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:51.981182 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-3a174b4c-20ec-4514-8286-ef5a885e8a00 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.151148 Jul 14 10:23:51.981727 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 488/959] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:51 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:53.002413 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:53.003021 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:53.009486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:53.009940 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:53.010704 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:53.011150 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:53.141498 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:53.149932 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:53.151446 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:53.152614 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a8375a6c-1fe2-4038-8be4-f88f9163299c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.154132 Jul 14 10:23:53.153214 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 472/960] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:52 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:54.171372 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:54.171990 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:54.178577 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:54.179032 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:54.179800 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:54.180241 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:54.311634 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:54.320068 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:54.321618 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:54.322779 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-add945b0-8f66-4e85-86e5-c550797405a0 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.155311 Jul 14 10:23:54.323337 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 489/961] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:54 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:55.340688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:55.341327 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:55.343731 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=22 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:55.349274 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:55.349734 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:55.350509 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:55.350955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:55.476263 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:55.484146 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:55.485680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:55.486828 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-baaec988-01b0-4c61-b6cd-5b4c54bcb5f4 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.150111 Jul 14 10:23:55.487385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 473/962] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:55 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:56.505889 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:56.506502 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:56.508872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=22 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:23:56.514413 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:56.514859 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:56.515619 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:56.516051 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:56.658367 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:56.666345 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:56.667855 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:56.669038 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f42e3db4-82dc-41f3-bdf3-9878c1edd957 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.167587 Jul 14 10:23:56.669588 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 490/963] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:56 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:57.687244 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:57.687863 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:57.695086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:57.695540 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:57.696311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:57.696753 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:57.822617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:57.830571 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:57.832100 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:57.833813 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-38ffee15-0c45-4ca7-962d-88a31d16de0b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.150503 Jul 14 10:23:57.834380 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 474/964] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:57 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:23:58.851684 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:23:58.852285 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:23:58.858829 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:58.859276 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:58.860034 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:23:58.860467 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:23:58.991888 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:58.999790 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:59.001326 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:23:59.002479 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c530ce95-4c09-4d8a-984b-618b96b58ba2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.154769 Jul 14 10:23:59.003028 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 491/965] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:23:58 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:00.021186 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:00.021781 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:00.028301 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:00.028750 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:00.029559 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:00.030001 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:00.162682 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:00.170561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:00.172059 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:00.173235 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-37d054bc-c6e3-4e9b-aa59-4d0ad756e1be tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.156594 Jul 14 10:24:00.173793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 475/966] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:00 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:01.191395 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:01.192001 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:01.198142 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:01.198591 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:01.199343 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:01.199780 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:01.327104 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:01.335587 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:01.337140 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:01.338302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-4f4e1093-5f2a-45c7-8072-1dad00e2b27f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.150859 Jul 14 10:24:01.338857 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 492/967] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:01 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:02.356613 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:02.357366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:02.363920 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:02.364371 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:02.365162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:02.365608 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:02.495249 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:02.503358 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:02.505570 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:02.506734 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-22e030e1-9fb2-43b6-a2fa-d99dfa116e90 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.154023 Jul 14 10:24:02.507298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 476/968] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:02 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:03.526036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:03.526682 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:03.533168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:03.533623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:03.534390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:03.534832 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:03.665268 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:03.673373 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:03.674900 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:03.676610 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-432d8113-fd75-484b-b95c-30c2dd1419c5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1744 microversion: 2.20 time: 0.154459 Jul 14 10:24:03.677195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 493/969] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:03 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:04.694892 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:04.695603 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:04.703020 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:04.703460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:04.704240 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:04.704681 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:04.844335 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:04.853163 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:04.854774 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:04.855939 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dadbbca4-fea8-41dd-83e6-19ca0ba512e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.165342 Jul 14 10:24:04.856506 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 477/970] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:04 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:05.452952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-8a628413-6491-485b-acf7-bae6bb1a8e8b req-6c7ffa91-f7a0-4ae3-984a-aa4ded86fa0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "name": "network-vif-plugged", "status": "completed", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:05.461862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-8a628413-6491-485b-acf7-bae6bb1a8e8b req-6c7ffa91-f7a0-4ae3-984a-aa4ded86fa0e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:05.462544 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-8a628413-6491-485b-acf7-bae6bb1a8e8b req-6c7ffa91-f7a0-4ae3-984a-aa4ded86fa0e service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:05.476879 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-8a628413-6491-485b-acf7-bae6bb1a8e8b req-6c7ffa91-f7a0-4ae3-984a-aa4ded86fa0e service nova] Creating event network-vif-plugged:7394de63-0ffc-4bd9-89f0-6e8ea590a6c1 for instance baef7bfd-8592-43c5-af1f-637b8fe59249 on hv-cinder-84980 Jul 14 10:24:05.483620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-8a628413-6491-485b-acf7-bae6bb1a8e8b req-6c7ffa91-f7a0-4ae3-984a-aa4ded86fa0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034763 Jul 14 10:24:05.484565 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 494/971] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:05.875716 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:05.876461 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:05.884440 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:05.885563 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:05.887340 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:05.887788 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:06.035997 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:06.045257 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:06.046790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:06.048467 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-302bb698-49ee-4fc4-916e-74efeb68b80c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.176713 Jul 14 10:24:06.059700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 478/972] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:05 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:07.070187 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:07.071722 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:07.078702 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:07.079195 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:07.080155 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:07.080599 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:07.223862 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:07.232541 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:07.239396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:07.241109 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-6aba9d0a-53a7-4839-b6fb-5c0e6c189668 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.177658 Jul 14 10:24:07.241876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 495/973] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:07 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:08.260315 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:08.262009 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:08.271925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:08.272666 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:08.273672 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:08.274305 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:08.430981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:08.439886 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:08.441936 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:08.443167 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3810a23d-0bf3-4f4b-9de5-471aa68ffbf2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.187154 Jul 14 10:24:08.443782 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 479/974] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:08 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:24:09.462378 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:09.463087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:09.470519 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:09.470979 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:09.471762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:09.472242 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:09.622389 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:09.634667 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:09.636484 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:09.637706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-730037b2-d516-4e7e-b2c2-0d29a82a2ed7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.179493 Jul 14 10:24:09.638529 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 496/975] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:09 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:10.655965 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:10.656627 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:10.663873 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:10.664323 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:10.665135 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:10.665632 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:10.821116 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:10.829548 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:10.831086 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:10.832321 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-caebea95-6313-44f3-a6a6-acb30e918032 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.180325 Jul 14 10:24:10.832888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 480/976] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:10 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:11.851097 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:11.852396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:11.858706 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:11.859161 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:11.859929 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:11.860366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:12.001693 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:12.012875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:12.012875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:12.013536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ede07be0-a226-4f67-9fe8-8666656e86d2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.166869 Jul 14 10:24:12.014430 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 497/977] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:11 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:13.032953 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:13.033732 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:13.043027 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:13.043909 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:13.045231 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:13.045674 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:13.190224 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:13.199359 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:13.201293 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:13.203092 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6d88defc-295c-448f-a7d4-80615749bb08 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1739 microversion: 2.20 time: 0.173964 Jul 14 10:24:13.204180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 481/978] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:13 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:14.223421 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:14.223958 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:14.230522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:14.230980 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:14.231751 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:14.232189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:14.366523 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:14.374658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:14.376198 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:14.377404 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c5ec3aa8-b0a3-477c-925c-3b5691834144 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1721 microversion: 2.20 time: 0.158808 Jul 14 10:24:14.377969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 498/979] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:14 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:15.396719 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:15.397348 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:15.403855 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:15.404300 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:15.405095 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:15.405530 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:15.533065 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:15.541083 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:15.542622 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:15.543791 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-dc494004-00cd-4f9b-8dc1-b3808cc41c2f tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1721 microversion: 2.20 time: 0.151575 Jul 14 10:24:15.544356 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 482/980] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:15 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:16.562310 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:16.562920 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:16.569813 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:16.570270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:16.571043 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:16.571488 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:16.704396 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:16.713015 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:16.714542 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:16.715712 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-565348c7-71df-4585-9ac7-2d7844fa4c72 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1724 microversion: 2.20 time: 0.157372 Jul 14 10:24:16.716261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 499/981] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:16 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:16.733391 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76c196d4-0c99-4b4a-b1eb-1e508dfd437d"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:16.734518 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:16.742261 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:16.742931 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:16.743851 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:16.744296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:16.747948 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.017428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cf674ed7-81e4-4f63-8bf1-a511fd76d99d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287992 Jul 14 10:24:17.018046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 483/982] 10.222.0.61 () {62 vars in 1363 bytes} [Thu Jul 14 10:24:16 2022] POST /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 10:24:17.133876 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:17.134394 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:17.140710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.141211 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.141982 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.142434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.326597 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-905895090"}} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:17.327176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:17.334490 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.334950 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.335735 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.336172 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.374757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-204a4400-c85d-45ce-a7e8-c4a7c7d045b8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-volume_attachments/76c196d4-0c99-4b4a-b1eb-1e508dfd437d" status: 202 len: 0 microversion: 2.20 time: 0.244785 Jul 14 10:24:17.375390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 500/983] 10.222.0.61 () {60 vars in 1456 bytes} [Thu Jul 14 10:24:17 2022] DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-volume_attachments/76c196d4-0c99-4b4a-b1eb-1e508dfd437d => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:24:17.436805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:17.437663 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:17.444096 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.444547 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.445350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.445776 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.472238 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.network.security_group_api [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Removing security group 80b09934-2cb8-479e-9e1f-6b1c41f0a652 from port a4970b22-3386-4b5b-93b1-f2bb8380d732 Jul 14 10:24:17.533114 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:17.553520 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-20914b7f-cd32-42aa-aa8f-d58e1e1ee754 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "POST /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/action" status: 202 len: 0 microversion: 2.20 time: 0.120722 Jul 14 10:24:17.557881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 501/984] 10.222.0.61 () {62 vars in 1318 bytes} [Thu Jul 14 10:24:17 2022] POST /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:24:17.562623 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-9b05d98e-bfd0-4bf7-abcc-adec669d513a req-6abe6184-e012-400b-8aff-f1773998651f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "name": "network-vif-unplugged", "status": "completed", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:17.572882 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-9b05d98e-bfd0-4bf7-abcc-adec669d513a req-6abe6184-e012-400b-8aff-f1773998651f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.573927 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-9b05d98e-bfd0-4bf7-abcc-adec669d513a req-6abe6184-e012-400b-8aff-f1773998651f service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.587591 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.compute.server_external_events [req-9b05d98e-bfd0-4bf7-abcc-adec669d513a req-6abe6184-e012-400b-8aff-f1773998651f service nova] Unable to find a host for instance baef7bfd-8592-43c5-af1f-637b8fe59249. Dropping event network-vif-unplugged {{(pid=117809) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 10:24:17.588499 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-9b05d98e-bfd0-4bf7-abcc-adec669d513a req-6abe6184-e012-400b-8aff-f1773998651f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029712 Jul 14 10:24:17.589114 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 502/985] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 10:24:17.593846 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:17.594460 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:17.601214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.601668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.602442 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:17.602881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:17.854749 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:17.863885 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:17.865434 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:17.866609 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-666cf85f-e10b-4fcc-b242-e084ff1a5d78 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1672 microversion: 2.20 time: 0.276577 Jul 14 10:24:17.867172 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 503/986] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:17 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1672 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:17.965006 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-20532e6f-de16-42b1-913d-171d2be9d18c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/action" status: 202 len: 0 microversion: 2.1 time: 0.642377 Jul 14 10:24:17.966107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 484/987] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Jul 14 10:24:17 2022] POST /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 10:24:17.986445 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-7712c9ae-7647-4726-a3c4-6305fff0318c req-ee003f79-cd4c-4a24-8fa4-17cb23a08983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:18.011407 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7712c9ae-7647-4726-a3c4-6305fff0318c req-ee003f79-cd4c-4a24-8fa4-17cb23a08983 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:18.011852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7712c9ae-7647-4726-a3c4-6305fff0318c req-ee003f79-cd4c-4a24-8fa4-17cb23a08983 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:18.034762 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-7712c9ae-7647-4726-a3c4-6305fff0318c req-ee003f79-cd4c-4a24-8fa4-17cb23a08983 service nova] Creating event network-changed:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:24:18.042568 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-7712c9ae-7647-4726-a3c4-6305fff0318c req-ee003f79-cd4c-4a24-8fa4-17cb23a08983 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060992 Jul 14 10:24:18.043115 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 504/988] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:18.887149 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:18.888107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:18.896472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:18.897262 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:18.898048 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:18.898711 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:19.186407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:19.195120 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:19.196638 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:19.197832 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-23e40086-ac17-4726-bc33-80d46c2ae452 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.316506 Jul 14 10:24:19.198390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 485/989] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:18 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:19.971087 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:19.972219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:19.978710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:19.979171 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:19.979952 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:19.980393 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:20.060606 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-bb123f3f-48de-4738-86bb-621b664c29a3 req-b830e220-9d78-49c3-a8d9-d042abd82516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:20.074175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.objects.instance [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lazy-loading 'services' on Instance uuid a6083b3f-b8e8-4540-b153-ae9b7c4cdffe {{(pid=117809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:24:20.075311 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-bb123f3f-48de-4738-86bb-621b664c29a3 req-b830e220-9d78-49c3-a8d9-d042abd82516 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:20.075839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-bb123f3f-48de-4738-86bb-621b664c29a3 req-b830e220-9d78-49c3-a8d9-d042abd82516 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:20.088624 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-bb123f3f-48de-4738-86bb-621b664c29a3 req-b830e220-9d78-49c3-a8d9-d042abd82516 service nova] Creating event network-changed:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:24:20.094612 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-bb123f3f-48de-4738-86bb-621b664c29a3 req-b830e220-9d78-49c3-a8d9-d042abd82516 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038289 Jul 14 10:24:20.096039 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 486/990] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:20.166728 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2ea57baa-8ae9-40ae-8e35-28706c0050b8 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments/f6a02af8-18f3-41b7-b283-9c0af483aee5" status: 202 len: 0 microversion: 2.1 time: 0.199898 Jul 14 10:24:20.168085 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 505/991] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:24:19 2022] DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments/f6a02af8-18f3-41b7-b283-9c0af483aee5 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:24:20.179124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:20.180264 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:20.189790 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:20.192062 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:20.193107 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:20.193761 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:20.217113 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:20.217807 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:20.226814 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:20.229868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:20.232691 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:20.235681 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:20.286068 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3b330338-e0d5-4570-93b6-6cfea5952161 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111224 Jul 14 10:24:20.293066 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 487/992] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:20 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:20.524162 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:20.532569 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:20.534626 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:20.535796 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1f2b48b0-a6c2-4a03-8728-d4f779fd917a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.323122 Jul 14 10:24:20.536348 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 506/993] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:20 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:24:21.300793 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:21.301744 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:21.308344 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:21.308791 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:21.309680 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:21.310364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:21.343748 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-17f5c176-9ad6-422c-b460-c51500c87228 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047655 Jul 14 10:24:21.344545 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 488/994] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:21 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:21.554050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:21.554677 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:21.561760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:21.562311 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:21.563175 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:21.563692 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:21.699731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:21.708509 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:21.710062 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:21.711242 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-def1d059-d2bc-47f3-9200-663937973edb tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.161774 Jul 14 10:24:21.711805 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 507/995] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:21 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:22.355861 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:22.357516 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:22.364494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:22.364954 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:22.365760 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:22.366180 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:22.399008 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6b77a1bb-478d-4470-ae23-8c8d2855b0ec tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Jul 14 10:24:22.399864 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 489/996] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:22 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:24:22.730115 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:22.730746 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:22.737535 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:22.737992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:22.738769 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:22.739214 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:22.876309 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:22.885107 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:22.886894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:22.888066 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2af83fea-d83e-490a-ad87-75165218cf36 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.161918 Jul 14 10:24:22.888624 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 508/997] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:22 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:24:23.411560 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:23.412705 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:23.419507 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:23.420056 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:23.420918 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:23.421445 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:23.452848 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-b87c6964-104b-4313-b1cf-a52e03e7492f tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Jul 14 10:24:23.457366 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 490/998] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:23 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:23.907550 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:23.909720 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:23.916378 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:23.916837 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:23.917694 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:23.918138 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:24.058200 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:24.066978 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:24.068515 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:24.069971 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-b16ab7aa-b102-41e9-b888-c3da2e70c3c7 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.166862 Jul 14 10:24:24.070536 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 509/999] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:23 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:24.464997 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:24.465929 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:24.472752 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:24.473219 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:24.474000 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:24.476552 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:24.507193 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2ee9f981-d5d6-465a-8ae9-fda08bc3bb13 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Jul 14 10:24:24.507691 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 491/1000] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:24 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:25.087883 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:25.088491 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:25.094934 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:25.095471 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:25.096179 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:25.096658 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:25.243013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:25.253121 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:25.254685 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:25.255852 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d19bfd9b-b501-4e47-a728-0736d77aad4c tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.171891 Jul 14 10:24:25.256412 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 510/1001] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:25 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:25.518998 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:25.519955 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:25.522339 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=38 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:25.527669 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:25.528119 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:25.528954 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:25.529344 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:25.559615 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3a7c644b-7523-4491-bf04-0f114c78504d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 Jul 14 10:24:25.560746 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 492/1002] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:25 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:26.274893 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:26.276238 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:26.283127 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:26.283583 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:26.284938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:26.285385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:26.429358 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:26.438045 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:26.440765 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:26.442638 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a087934f-77d5-4c62-861d-9db0280c4ebe tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.171310 Jul 14 10:24:26.443738 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 511/1003] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:26 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:26.571925 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:26.572895 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:26.579861 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:26.580407 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:26.581512 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:26.582029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:26.615721 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0a037b5b-7139-484a-9299-e183fecae086 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Jul 14 10:24:26.616298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 493/1004] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:26 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:24:27.461264 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:27.461949 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:27.467657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=46 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:27.473912 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:27.474373 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:27.475164 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:27.475615 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:27.617303 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:27.625810 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:27.627122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:27.627781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:27.628099 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:27.629132 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-9090fd4d-41e4-4bb9-ac35-2733bcf4d03a tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.171921 Jul 14 10:24:27.638878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:27.639572 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:27.640428 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:27.641039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 512/1005] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:27 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:27.641182 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:27.673883 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-66130f86-0718-4293-8f72-45cfd5e1bc82 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050593 Jul 14 10:24:27.674486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 494/1006] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:27 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:24:28.647836 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:28.648425 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:28.655318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:28.655784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:28.656571 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:28.657049 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:28.685633 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:28.686578 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:28.697258 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:28.698316 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:28.699307 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:28.700042 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:28.731662 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-f94368a6-dd2a-4f7d-88f7-f86ece7ebff2 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049964 Jul 14 10:24:28.732448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 495/1007] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:28 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:24:28.801064 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:28.809169 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:28.810766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:28.811939 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-d3c9bd82-2d22-461a-86e5-fe1ec8492d34 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.168202 Jul 14 10:24:28.812668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 513/1008] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:28 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:29.743981 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:29.744902 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:29.751445 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:29.751898 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:29.752675 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:29.753147 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:29.782317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-cda94dd2-2b53-42e0-bcc1-040c254ad96c tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 Jul 14 10:24:29.782874 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 496/1009] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:29 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:29.831056 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:29.831683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:29.838189 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:29.838647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:29.839448 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:29.839890 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:29.966790 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:29.975336 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:29.976863 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:29.978052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-a2b44fcd-6424-4011-a184-8c0367e9a4a2 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.151476 Jul 14 10:24:29.978612 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 514/1010] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:29 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:30.794578 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:30.795425 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:30.802455 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:30.802908 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:30.803679 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:30.804122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:30.832388 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-40d74b4a-20fd-417a-80ef-90200718287d tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041917 Jul 14 10:24:30.832954 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 497/1011] 10.222.0.61 () {58 vars in 1301 bytes} [Thu Jul 14 10:24:30 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 10:24:30.842613 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:30.843115 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:30.849760 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:30.850208 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:30.850969 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:30.851408 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:30.925365 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] HTTP exception thrown: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe is not attached to volume f6a02af8-18f3-41b7-b283-9c0af483aee5 Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Request method failure captured: Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments/f6a02af8-18f3-41b7-b283-9c0af483aee5 HTTP/1.1 Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-5PLS_KK34rMfjVlusJC_ALL2-Lbqe1-ayH3oWCA2e0Do7byR38D4IFzWo5_CNBTmPeT8upDGB9W8c04r3zg-pVpikjRZVQj4E1u8RZgt-Tlm1so3nub310lxDOlMS6p5n5CAa-WHNqaosY_ntFYrO0QRRqrqiEn-wfpUj6IlA796s Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 936db5c6e71f4012a4838d484c1ca92e Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-TestMinimumBasicScenario-1017685695 Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:24:30.927730 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_936db5c6e71f4012a4838d484c1ca92e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/936db5c6e71f4012a4838d484c1ca92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/936db5c6e71f4012a4838d484c1ca92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/936db5c6e71f4012a4838d484c1ca92e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-TestMinimumBasicScenario-1017685695 Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 936db5c6e71f4012a4838d484c1ca92e Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1017685695 Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-TestMinimumBasicScenario-1017685695-project Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 1c009a915aad4fe9b8c334e64ecb2e48 Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-TestMinimumBasicScenario-1017685695-project Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:24:30.929453 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe is not attached to volume f6a02af8-18f3-41b7-b283-9c0af483aee5 Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'server_id': 'a6083b3f-b8e8-4540-b153-ae9b7c4cdffe', 'id': 'f6a02af8-18f3-41b7-b283-9c0af483aee5'} Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6a02af8-18f3-41b7-b283-9c0af483aee5. Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:24:30.930293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe is not attached to volume f6a02af8-18f3-41b7-b283-9c0af483aee5 Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe is not attached to volume f6a02af8-18f3-41b7-b283-9c0af483aee5 Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:30.931605 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Returning 404 to user: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe is not attached to volume f6a02af8-18f3-41b7-b283-9c0af483aee5 {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:24:30.932649 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2c1da1b2-a384-4287-8125-01353a65c44b tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments/f6a02af8-18f3-41b7-b283-9c0af483aee5" status: 404 len: 154 microversion: 2.1 time: 0.090527 Jul 14 10:24:30.932649 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 515/1012] 10.222.0.61 () {58 vars in 1415 bytes} [Thu Jul 14 10:24:30 2022] DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe/os-volume_attachments/f6a02af8-18f3-41b7-b283-9c0af483aee5 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:24:30.996688 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:30.997346 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:31.003501 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:31.003957 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:31.004730 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:31.005203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:31.009259 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:31.144761 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:31.152722 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:31.154260 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:31.155421 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2efc0f39-e7b2-4e63-ab84-16fb5792e34b tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.163625 Jul 14 10:24:31.155979 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 498/1013] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:30 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:32.066036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:32.066576 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:32.072998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:32.073462 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:32.074263 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:32.074710 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:32.103319 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Going to try to terminate instance {{(pid=117809) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:24:32.174466 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:32.175212 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:32.181243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-856b6341-d1b7-44e2-b413-bbd9f7118425 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 204 len: 0 microversion: 2.1 time: 0.119576 Jul 14 10:24:32.182655 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:32.183208 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:32.184077 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:32.184591 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:32.185731 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 516/1014] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:24:32 2022] DELETE /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:24:32.192470 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:32.193210 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:32.199362 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:32.199816 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:32.200592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:32.201062 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:32.219261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:32.388868 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:32.392215 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:32.397122 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:32.398709 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:32.399951 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-81060308-725f-486a-b04b-9c80d40dc51d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.230080 Jul 14 10:24:32.400581 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 499/1015] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:32 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:24:32.401124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-58909dc2-7e54-4c02-a94c-1bf180d6dc06 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1554 microversion: 2.1 time: 0.214203 Jul 14 10:24:32.401687 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 517/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:32 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:24:33.418538 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:33.419196 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:33.419196 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:33.419639 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:33.426897 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:33.427086 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:33.427350 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:33.427823 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:33.428110 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:33.428550 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:33.428667 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:33.429550 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:33.632864 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:33.636262 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:33.642449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e3163b4a-3ac2-43e6-8d19-cdf1fae2cd44 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1554 microversion: 2.1 time: 0.227408 Jul 14 10:24:33.643332 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 518/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:33 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:24:33.647770 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-fa8078c9-b02e-4bfe-99a2-95b6af65ddcd req-e3f562fc-e188-4b45-8924-2646bee09417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "name": "network-vif-plugged", "status": "completed", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:33.648582 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:33.650144 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:33.651317 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-e8746ebb-7d8e-47f9-b0f3-94a0fe82c207 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.236737 Jul 14 10:24:33.651874 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 500/1018] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:33 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:24:33.661415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-fa8078c9-b02e-4bfe-99a2-95b6af65ddcd req-e3f562fc-e188-4b45-8924-2646bee09417 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:33.661874 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-fa8078c9-b02e-4bfe-99a2-95b6af65ddcd req-e3f562fc-e188-4b45-8924-2646bee09417 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:33.673009 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-fa8078c9-b02e-4bfe-99a2-95b6af65ddcd req-e3f562fc-e188-4b45-8924-2646bee09417 service nova] Creating event network-vif-plugged:7394de63-0ffc-4bd9-89f0-6e8ea590a6c1 for instance baef7bfd-8592-43c5-af1f-637b8fe59249 on hv-cinder-84980 Jul 14 10:24:33.677857 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-fa8078c9-b02e-4bfe-99a2-95b6af65ddcd req-e3f562fc-e188-4b45-8924-2646bee09417 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Jul 14 10:24:33.678452 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 519/1019] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:34.367839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-bdc06b5f-661e-4e8b-a926-908b66e706db req-ddf1d42c-2c10-4c34-b6dc-659743062bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6083b3f-b8e8-4540-b153-ae9b7c4cdffe", "name": "network-vif-deleted", "tag": "a4970b22-3386-4b5b-93b1-f2bb8380d732"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:34.377358 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-bdc06b5f-661e-4e8b-a926-908b66e706db req-ddf1d42c-2c10-4c34-b6dc-659743062bc4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:34.377842 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-bdc06b5f-661e-4e8b-a926-908b66e706db req-ddf1d42c-2c10-4c34-b6dc-659743062bc4 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:34.389449 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-bdc06b5f-661e-4e8b-a926-908b66e706db req-ddf1d42c-2c10-4c34-b6dc-659743062bc4 service nova] Creating event network-vif-deleted:a4970b22-3386-4b5b-93b1-f2bb8380d732 for instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe on hv-cinder-84980 Jul 14 10:24:34.394888 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-bdc06b5f-661e-4e8b-a926-908b66e706db req-ddf1d42c-2c10-4c34-b6dc-659743062bc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Jul 14 10:24:34.395488 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 501/1020] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:34.661764 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:34.662477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:34.669179 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:34.669644 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:34.670433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:34.670885 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:34.671292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:34.671984 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:34.678580 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:34.679332 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:34.680404 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:34.681020 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:34.783046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c009a915aad4fe9b8c334e64ecb2e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '936db5c6e71f4012a4838d484c1ca92e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:34.791603 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2cb154ea-52c4-4e63-a1ce-d4d471ff517e tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 200 len: 1343 microversion: 2.1 time: 0.135428 Jul 14 10:24:34.792190 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 520/1021] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:34 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 1343 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:24:34.855450 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:34.863543 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:34.865105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:34.866270 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0e4ec7fa-565d-40f0-9bf8-07e0412981e3 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1730 microversion: 2.20 time: 0.200099 Jul 14 10:24:34.866827 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 502/1022] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:34 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 10:24:35.808881 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:35.809495 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] [instance: a6083b3f-b8e8-4540-b153-ae9b7c4cdffe] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:35.816050 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:35.816496 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:35.817287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:35.817748 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:35.831308 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] HTTP exception thrown: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe could not be found. Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Request method failure captured: Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe HTTP/1.1 Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-5PLS_KK34rMfjVlusJC_ALL2-Lbqe1-ayH3oWCA2e0Do7byR38D4IFzWo5_CNBTmPeT8upDGB9W8c04r3zg-pVpikjRZVQj4E1u8RZgt-Tlm1so3nub310lxDOlMS6p5n5CAa-WHNqaosY_ntFYrO0QRRqrqiEn-wfpUj6IlA796s Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 936db5c6e71f4012a4838d484c1ca92e Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-TestMinimumBasicScenario-1017685695 Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:24:35.832951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_936db5c6e71f4012a4838d484c1ca92e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/936db5c6e71f4012a4838d484c1ca92e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/936db5c6e71f4012a4838d484c1ca92e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/936db5c6e71f4012a4838d484c1ca92e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-TestMinimumBasicScenario-1017685695 Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 936db5c6e71f4012a4838d484c1ca92e Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1017685695 Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-TestMinimumBasicScenario-1017685695-project Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 1c009a915aad4fe9b8c334e64ecb2e48 Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-TestMinimumBasicScenario-1017685695-project Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe could not be found. Jul 14 10:24:35.834627 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'a6083b3f-b8e8-4540-b153-ae9b7c4cdffe'} Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe could not be found. Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:24:35.835754 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe could not be found. Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe could not be found. Jul 14 10:24:35.837390 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:35.839000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Returning 404 to user: Instance a6083b3f-b8e8-4540-b153-ae9b7c4cdffe could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:24:35.839000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-353a2925-25d0-4ddb-81bd-09a6e6546794 tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe" status: 404 len: 111 microversion: 2.1 time: 0.029349 Jul 14 10:24:35.839000 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 521/1023] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:35 2022] GET /compute/v2.1/servers/a6083b3f-b8e8-4540-b153-ae9b7c4cdffe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:24:35.842845 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-0938d503-0370-4231-b8bb-5c87f477641a tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] Calling method '.version_select at 0x7f56259ef820>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:35.860093 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-0938d503-0370-4231-b8bb-5c87f477641a tempest-TestMinimumBasicScenario-1017685695 tempest-TestMinimumBasicScenario-1017685695-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-304069724" status: 202 len: 0 microversion: 2.1 time: 0.020948 Jul 14 10:24:35.860554 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 503/1024] 10.222.0.61 () {58 vars in 1268 bytes} [Thu Jul 14 10:24:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-304069724 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:24:35.884569 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:35.885522 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:35.891696 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:35.892272 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:35.893628 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:35.894067 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:36.026254 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:36.034757 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:36.036382 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:36.037645 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c00c7a59-dd12-4570-99ee-b8da8d85362d tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1717 microversion: 2.20 time: 0.157315 Jul 14 10:24:36.038201 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 522/1025] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:24:35 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:24:53.481671 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_cell1:SELECT=25 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:53.488440 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-6a51bae8-518f-4a58-a054-322571cda0dd req-10f7f751-a17b-43c5-aa46-e45244875b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a91a52d-5efe-404d-a6a4-8ece6166bfc6", "tag": "b386cc07-26ba-4101-8453-fa07ec85945c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:53.493903 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:53.494652 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG dbcounter [-] [117809] Writing DB stats nova_cell1:SELECT=24 {{(pid=117809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:53.497364 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG dbcounter [-] [117810] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=117810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 10:24:53.501747 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:53.502250 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:53.510141 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:53.510599 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:53.511243 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6a51bae8-518f-4a58-a054-322571cda0dd req-10f7f751-a17b-43c5-aa46-e45244875b02 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:53.511379 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:53.511703 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-6a51bae8-518f-4a58-a054-322571cda0dd req-10f7f751-a17b-43c5-aa46-e45244875b02 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:53.511819 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:53.524869 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-6a51bae8-518f-4a58-a054-322571cda0dd req-10f7f751-a17b-43c5-aa46-e45244875b02 service nova] Creating event network-changed:b386cc07-26ba-4101-8453-fa07ec85945c for instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 on hv-cinder-84980 Jul 14 10:24:53.530477 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-6a51bae8-518f-4a58-a054-322571cda0dd req-10f7f751-a17b-43c5-aa46-e45244875b02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046520 Jul 14 10:24:53.531142 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 523/1026] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:53.539140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:24:53.621098 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-fa1f6b14-24b2-4cfd-82c6-7380c1e9b6a9 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 204 len: 0 microversion: 2.1 time: 0.140703 Jul 14 10:24:53.622032 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 504/1027] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:24:53 2022] DELETE /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:24:53.631036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:53.632553 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:53.639318 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:53.639781 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:53.640624 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:53.641119 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:53.809674 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:53.817559 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-7a1a65e4-24ab-4170-b707-0928c5f5e4f4 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1578 microversion: 2.1 time: 0.191368 Jul 14 10:24:53.818250 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 524/1028] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:53 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:24:54.835825 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:54.836486 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:54.843085 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:54.843539 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:54.844304 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:54.844768 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:55.068106 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:55.075878 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-3d1e201d-c56a-4a65-98b9-4266388de4cb tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1578 microversion: 2.1 time: 0.244328 Jul 14 10:24:55.076460 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 505/1029] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:54 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1578 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:24:55.870429 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-7847b571-0041-4cc6-be81-6478130bee69 req-c5b53364-1d11-435f-b9f3-b8140dee4c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a91a52d-5efe-404d-a6a4-8ece6166bfc6", "name": "network-vif-deleted", "tag": "b386cc07-26ba-4101-8453-fa07ec85945c"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:24:55.878668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7847b571-0041-4cc6-be81-6478130bee69 req-c5b53364-1d11-435f-b9f3-b8140dee4c02 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:55.879124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-7847b571-0041-4cc6-be81-6478130bee69 req-c5b53364-1d11-435f-b9f3-b8140dee4c02 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:55.891027 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-7847b571-0041-4cc6-be81-6478130bee69 req-c5b53364-1d11-435f-b9f3-b8140dee4c02 service nova] Creating event network-vif-deleted:b386cc07-26ba-4101-8453-fa07ec85945c for instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 on hv-cinder-84980 Jul 14 10:24:55.896144 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-7847b571-0041-4cc6-be81-6478130bee69 req-c5b53364-1d11-435f-b9f3-b8140dee4c02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207677 Jul 14 10:24:55.896944 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 525/1030] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:24:56.094472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:56.095644 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:56.102532 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:56.103004 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:56.103799 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:56.104236 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:56.135673 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:56.136126 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:56.136574 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.objects.instance [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lazy-loading 'fault' on Instance uuid 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 {{(pid=117810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 10:24:56.177561 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:24:56.184969 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-2e283d09-428b-44fd-9ba8-fa7026f578ba tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 200 len: 1231 microversion: 2.1 time: 0.094356 Jul 14 10:24:56.185523 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 506/1031] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:56 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:24:57.203028 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:24:57.203732 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 9a91a52d-5efe-404d-a6a4-8ece6166bfc6] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:24:57.210581 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:57.211038 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:57.211804 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:24:57.212249 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:24:57.225647 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] HTTP exception thrown: Instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 could not be found. Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Request method failure captured: Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 HTTP/1.1 Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-0jn51-_eUptSQxR76i7Zj658zZJiBdOryHkDUxXJrusEra9J5v8Vst9BzNvW2RKyJ1PWfjF1xZrb51o1DMQnAfpR7XMMhd9djovqpUe_YP408gUT_J8MDsn8JBks7yZKtpJlCatqaso8Op2iNMzXajtrbLwhdf-6eEiGjwD4fobCU Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:24:57.227266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f5484157d3894ec097d1f1b2e0bacc16", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-TestVolumeBootPattern-951692695 Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 8cd8f0490c6949cbba431b0b317683fd Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 could not be found. Jul 14 10:24:57.228998 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '9a91a52d-5efe-404d-a6a4-8ece6166bfc6'} Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 could not be found. Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:24:57.229947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 could not be found. Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 could not be found. Jul 14 10:24:57.231237 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:24:57.232385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Returning 404 to user: Instance 9a91a52d-5efe-404d-a6a4-8ece6166bfc6 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:24:57.232385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-1d841506-dbe9-47ab-996f-c09b94136c7a tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6" status: 404 len: 111 microversion: 2.1 time: 0.030411 Jul 14 10:24:57.232385 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 526/1032] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:24:57 2022] GET /compute/v2.1/servers/9a91a52d-5efe-404d-a6a4-8ece6166bfc6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:00.280490 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:00.281046 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:00.282657 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-215a7f9d-a29e-4b25-bed1-833d121fd8dc req-bf36c3a0-3bad-470a-834f-c9bd44981fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0878a889-2692-4dab-8be3-52a648470261", "tag": "843c538b-92d0-432e-89e7-4dcf474bc2e2"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:00.287891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:00.288355 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:00.289162 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:00.289610 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:00.292756 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-215a7f9d-a29e-4b25-bed1-833d121fd8dc req-bf36c3a0-3bad-470a-834f-c9bd44981fb1 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:00.294039 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-215a7f9d-a29e-4b25-bed1-833d121fd8dc req-bf36c3a0-3bad-470a-834f-c9bd44981fb1 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:00.306817 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-215a7f9d-a29e-4b25-bed1-833d121fd8dc req-bf36c3a0-3bad-470a-834f-c9bd44981fb1 service nova] Creating event network-changed:843c538b-92d0-432e-89e7-4dcf474bc2e2 for instance 0878a889-2692-4dab-8be3-52a648470261 on hv-cinder-84980 Jul 14 10:25:00.312723 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-215a7f9d-a29e-4b25-bed1-833d121fd8dc req-bf36c3a0-3bad-470a-834f-c9bd44981fb1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033638 Jul 14 10:25:00.314302 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 527/1033] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 10:25:00.319373 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:25:00.400477 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-44727744-c9be-4968-af88-5bf6bc8418c0 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 204 len: 0 microversion: 2.1 time: 0.123667 Jul 14 10:25:00.401797 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 507/1034] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:25:00 2022] DELETE /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 10:25:00.422443 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:00.425042 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:00.437209 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:00.437669 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:00.439046 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:00.439486 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:00.580293 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:00.588124 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-fa8169b5-7388-4692-af99-149c27688655 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1577 microversion: 2.1 time: 0.181770 Jul 14 10:25:00.588697 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 528/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:00 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 10:25:01.606131 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:01.606839 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:01.613909 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:01.614402 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:01.615175 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:01.615617 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:01.751353 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:01.759255 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-ec91d8a8-504d-42b1-baf1-d6428b018014 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1577 microversion: 2.1 time: 0.157118 Jul 14 10:25:01.759830 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 508/1036] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:01 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:02.771299 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [req-ac532abe-29b6-459a-a54c-83999b83c33c req-e5501c24-2c54-414b-867f-5afdca408aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0878a889-2692-4dab-8be3-52a648470261", "name": "network-vif-deleted", "tag": "843c538b-92d0-432e-89e7-4dcf474bc2e2"}]} {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:02.777140 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:02.778326 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:02.779938 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-ac532abe-29b6-459a-a54c-83999b83c33c req-e5501c24-2c54-414b-867f-5afdca408aa6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:02.780480 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [req-ac532abe-29b6-459a-a54c-83999b83c33c req-e5501c24-2c54-414b-867f-5afdca408aa6 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:02.786583 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:02.787040 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:02.787962 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:02.788415 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:02.792842 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.compute.server_external_events [req-ac532abe-29b6-459a-a54c-83999b83c33c req-e5501c24-2c54-414b-867f-5afdca408aa6 service nova] Creating event network-vif-deleted:843c538b-92d0-432e-89e7-4dcf474bc2e2 for instance 0878a889-2692-4dab-8be3-52a648470261 on hv-cinder-84980 Jul 14 10:25:02.797683 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [req-ac532abe-29b6-459a-a54c-83999b83c33c req-e5501c24-2c54-414b-867f-5afdca408aa6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030312 Jul 14 10:25:02.798287 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 529/1037] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:25:02.864018 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd8f0490c6949cbba431b0b317683fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5484157d3894ec097d1f1b2e0bacc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:02.871550 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a9ff14ca-666c-4929-9391-e6ea2f7dc443 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 200 len: 1225 microversion: 2.1 time: 0.100075 Jul 14 10:25:02.872124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 509/1038] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:02 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:03.892875 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:03.893592 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: 0878a889-2692-4dab-8be3-52a648470261] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:03.899905 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:03.900366 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:03.901170 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:03.901620 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:03.915524 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] HTTP exception thrown: Instance 0878a889-2692-4dab-8be3-52a648470261 could not be found. Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Request method failure captured: Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 HTTP/1.1 Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-0jn51-_eUptSQxR76i7Zj658zZJiBdOryHkDUxXJrusEra9J5v8Vst9BzNvW2RKyJ1PWfjF1xZrb51o1DMQnAfpR7XMMhd9djovqpUe_YP408gUT_J8MDsn8JBks7yZKtpJlCatqaso8Op2iNMzXajtrbLwhdf-6eEiGjwD4fobCU Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:25:03.917159 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f5484157d3894ec097d1f1b2e0bacc16", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 8cd8f0490c6949cbba431b0b317683fd Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 0878a889-2692-4dab-8be3-52a648470261 could not be found. Jul 14 10:25:03.918886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '0878a889-2692-4dab-8be3-52a648470261'} Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0878a889-2692-4dab-8be3-52a648470261 could not be found. Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:03.920031 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0878a889-2692-4dab-8be3-52a648470261 could not be found. Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0878a889-2692-4dab-8be3-52a648470261 could not be found. Jul 14 10:25:03.921668 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:03.923258 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Returning 404 to user: Instance 0878a889-2692-4dab-8be3-52a648470261 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:03.923258 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-c3bb5b9a-2718-4626-bf07-5864c43f7ea5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261" status: 404 len: 111 microversion: 2.1 time: 0.033637 Jul 14 10:25:03.923258 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 530/1039] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:03 2022] GET /compute/v2.1/servers/0878a889-2692-4dab-8be3-52a648470261 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:04.355780 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:04.356298 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:04.363401 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:04.363861 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:04.364631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:04.365105 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:04.378998 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] HTTP exception thrown: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Request method failure captured: Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: DELETE /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 HTTP/1.1 Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-0jn51-_eUptSQxR76i7Zj658zZJiBdOryHkDUxXJrusEra9J5v8Vst9BzNvW2RKyJ1PWfjF1xZrb51o1DMQnAfpR7XMMhd9djovqpUe_YP408gUT_J8MDsn8JBks7yZKtpJlCatqaso8Op2iNMzXajtrbLwhdf-6eEiGjwD4fobCU Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:25:04.380642 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f5484157d3894ec097d1f1b2e0bacc16", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 8cd8f0490c6949cbba431b0b317683fd Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.382296 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'ce402fd6-a9d2-4651-9e76-aa616b99b208'} Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:04.383252 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.385101 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.386646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Returning 404 to user: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:04.386646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d6666197-bea9-46e4-89a7-f5cf2aef64f5 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 404 len: 111 microversion: 2.1 time: 0.030262 Jul 14 10:25:04.386646 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 510/1040] 10.222.0.61 () {58 vars in 1238 bytes} [Thu Jul 14 10:25:04 2022] DELETE /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:04.390964 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:04.391593 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] [instance: ce402fd6-a9d2-4651-9e76-aa616b99b208] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:04.397708 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:04.398168 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:04.398951 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:04.399399 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:04.412886 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] HTTP exception thrown: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Request method failure captured: Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 HTTP/1.1 Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-0jn51-_eUptSQxR76i7Zj658zZJiBdOryHkDUxXJrusEra9J5v8Vst9BzNvW2RKyJ1PWfjF1xZrb51o1DMQnAfpR7XMMhd9djovqpUe_YP408gUT_J8MDsn8JBks7yZKtpJlCatqaso8Op2iNMzXajtrbLwhdf-6eEiGjwD4fobCU Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:25:04.414439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f5484157d3894ec097d1f1b2e0bacc16", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f5484157d3894ec097d1f1b2e0bacc16"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: f5484157d3894ec097d1f1b2e0bacc16 Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-TestVolumeBootPattern-951692695 Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 8cd8f0490c6949cbba431b0b317683fd Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-TestVolumeBootPattern-951692695-project Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.416013 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'ce402fd6-a9d2-4651-9e76-aa616b99b208'} Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:04.416840 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. Jul 14 10:25:04.418135 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:04.419266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Returning 404 to user: Instance ce402fd6-a9d2-4651-9e76-aa616b99b208 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:04.419266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-e4628ed6-a53a-4ce2-addc-1deb56b388d1 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208" status: 404 len: 111 microversion: 2.1 time: 0.028742 Jul 14 10:25:04.419266 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 531/1041] 10.222.0.61 () {58 vars in 1235 bytes} [Thu Jul 14 10:25:04 2022] GET /compute/v2.1/servers/ce402fd6-a9d2-4651-9e76-aa616b99b208 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 10:25:05.925200 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-27803b0e-c712-4eae-8146-4ad3eea9b470 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] Calling method '.version_select at 0x7f56257dc4c0>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:05.948966 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-27803b0e-c712-4eae-8146-4ad3eea9b470 tempest-TestVolumeBootPattern-951692695 tempest-TestVolumeBootPattern-951692695-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2142394265" status: 202 len: 0 microversion: 2.1 time: 0.028009 Jul 14 10:25:05.949780 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 511/1042] 10.222.0.61 () {58 vars in 1262 bytes} [Thu Jul 14 10:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2142394265 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 10:25:09.473342 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:09.474270 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:09.482036 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:09.482737 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:09.483511 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:09.483947 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:09.517449 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-10aafb80-c878-4be1-8180-4f187582a544 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047911 Jul 14 10:25:09.518291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 532/1043] 10.222.0.61 () {60 vars in 1342 bytes} [Thu Jul 14 10:25:09 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 10:25:09.583912 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:09.584493 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:09.591785 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:09.592265 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:09.593049 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:09.593494 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:09.619789 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Going to try to terminate instance {{(pid=117810) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 10:25:09.698843 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-39a745a0-127f-46d3-a2c5-de1fc2a7f843 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 204 len: 0 microversion: 2.20 time: 0.118502 Jul 14 10:25:09.699529 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 512/1044] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jul 14 10:25:09 2022] DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:25:09.708307 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:09.708950 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:09.715049 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:09.715514 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:09.716291 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:09.716736 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:09.855641 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:09.864277 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:09.865838 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:09.867023 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-246b0639-d619-4737-92c4-d992e7d5f263 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.162997 Jul 14 10:25:09.867589 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 533/1045] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:25:09 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:25:10.887590 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:10.888303 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:10.895714 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:10.896176 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:10.896999 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:10.897445 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:11.042007 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:11.051183 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:11.053029 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.policy [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117810) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:11.054406 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-a9dff5c7-74c2-416d-8c34-2f84254642a6 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1723 microversion: 2.20 time: 0.171851 Jul 14 10:25:11.054964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 513/1046] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:25:10 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:25:12.074766 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:12.075617 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:12.083152 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:12.083911 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:12.084811 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:12.085415 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:12.276531 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:12.286828 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:12.288363 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.policy [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7b0f433eba57485cbbfeab651a8e8b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f945783031448849dc0e5a3337f8c76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117809) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 10:25:12.305646 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-599101b6-2074-4fd4-a953-682407a249b5 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 200 len: 1655 microversion: 2.20 time: 0.219306 Jul 14 10:25:12.309023 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 534/1047] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:25:12 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 1655 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 10:25:12.667088 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [req-6681b5c8-ff7f-49df-a87f-be6d71bf3e37 req-5864238b-c228-425f-95b3-aaba7851e842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baef7bfd-8592-43c5-af1f-637b8fe59249", "name": "network-vif-deleted", "tag": "7394de63-0ffc-4bd9-89f0-6e8ea590a6c1"}]} {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 10:25:12.691448 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-6681b5c8-ff7f-49df-a87f-be6d71bf3e37 req-5864238b-c228-425f-95b3-aaba7851e842 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:12.691602 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [req-6681b5c8-ff7f-49df-a87f-be6d71bf3e37 req-5864238b-c228-425f-95b3-aaba7851e842 service nova] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:12.710203 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.compute.server_external_events [req-6681b5c8-ff7f-49df-a87f-be6d71bf3e37 req-5864238b-c228-425f-95b3-aaba7851e842 service nova] Creating event network-vif-deleted:7394de63-0ffc-4bd9-89f0-6e8ea590a6c1 for instance baef7bfd-8592-43c5-af1f-637b8fe59249 on hv-cinder-84980 Jul 14 10:25:12.715397 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [req-6681b5c8-ff7f-49df-a87f-be6d71bf3e37 req-5864238b-c228-425f-95b3-aaba7851e842 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188884 Jul 14 10:25:12.716367 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 514/1048] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Jul 14 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 10:25:13.324073 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:13.325872 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:13.332868 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:13.333521 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:13.334695 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:13.335433 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:13.351743 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] HTTP exception thrown: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Request method failure captured: Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 HTTP/1.1 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-3StXhBjDqCR22P4lkix2HrCXW5G2YBPicqUvD8PwfSS975dnEyQAN-MSMvgc3Qcigy1CvDGgzbNsDhVPBn8FavCH7_c8nX_ZqcKxRBPqSniuVHdsx3M8GYm-0jvMbEMTll_Zol7AcKUZx4uufjXqe9k2frFyrQLgiCe7cIIU3DuPU Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:25:13.354167 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4f945783031448849dc0e5a3337f8c76", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 7b0f433eba57485cbbfeab651a8e8b02 Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:13.355671 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'baef7bfd-8592-43c5-af1f-637b8fe59249'} Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:13.356851 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:13.358364 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:13.361234 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Returning 404 to user: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:13.362335 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-ddda953d-f52b-4855-9fe9-29cba93e67ca tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 404 len: 111 microversion: 2.20 time: 0.042586 Jul 14 10:25:13.363020 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 535/1049] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:25:13 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:25:13.372967 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-8efa3949-268b-4f99-996f-b35d229f7832 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '.version_select at 0x7f562587ab80>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:13.394540 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-8efa3949-268b-4f99-996f-b35d229f7832 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-440503830" status: 204 len: 0 microversion: 2.20 time: 0.026279 Jul 14 10:25:13.397113 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 515/1050] 10.222.0.61 () {60 vars in 1258 bytes} [Thu Jul 14 10:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-440503830 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 10:25:15.233368 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:15.233925 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:15.240784 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:15.241261 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:15.242042 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:15.242482 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:15.257815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] HTTP exception thrown: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Request method failure captured: Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 HTTP/1.1 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-3StXhBjDqCR22P4lkix2HrCXW5G2YBPicqUvD8PwfSS975dnEyQAN-MSMvgc3Qcigy1CvDGgzbNsDhVPBn8FavCH7_c8nX_ZqcKxRBPqSniuVHdsx3M8GYm-0jvMbEMTll_Zol7AcKUZx4uufjXqe9k2frFyrQLgiCe7cIIU3DuPU Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:25:15.259631 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4f945783031448849dc0e5a3337f8c76", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 7b0f433eba57485cbbfeab651a8e8b02 Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.261439 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': 'baef7bfd-8592-43c5-af1f-637b8fe59249'} Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:15.262384 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.263928 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.266235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Returning 404 to user: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:15.266235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-2790021e-026a-4c10-8d3f-67b8d6374028 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 404 len: 111 microversion: 2.20 time: 0.031636 Jul 14 10:25:15.266235 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 536/1051] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jul 14 10:25:15 2022] DELETE /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:25:15.270992 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:15.271720 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: baef7bfd-8592-43c5-af1f-637b8fe59249] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:15.277934 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:15.278385 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:15.279323 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:15.279900 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:15.293743 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] HTTP exception thrown: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Request method failure captured: Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 HTTP/1.1 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-3StXhBjDqCR22P4lkix2HrCXW5G2YBPicqUvD8PwfSS975dnEyQAN-MSMvgc3Qcigy1CvDGgzbNsDhVPBn8FavCH7_c8nX_ZqcKxRBPqSniuVHdsx3M8GYm-0jvMbEMTll_Zol7AcKUZx4uufjXqe9k2frFyrQLgiCe7cIIU3DuPU Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:25:15.295408 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4f945783031448849dc0e5a3337f8c76", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 7b0f433eba57485cbbfeab651a8e8b02 Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.297174 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': 'baef7bfd-8592-43c5-af1f-637b8fe59249'} Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:15.298124 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. Jul 14 10:25:15.299631 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:15.301050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Returning 404 to user: Instance baef7bfd-8592-43c5-af1f-637b8fe59249 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:15.301050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-6ac83ceb-fbc6-4ae2-b498-f01f4f318311 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249" status: 404 len: 111 microversion: 2.20 time: 0.030463 Jul 14 10:25:15.301050 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 516/1052] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:25:15 2022] GET /compute/v2.1/servers/baef7bfd-8592-43c5-af1f-637b8fe59249 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:25:16.431061 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:16.431561 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.compute.api [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117809) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:16.438040 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:16.438484 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:16.439242 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:16.439705 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG oslo_concurrency.lockutils [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.wsgi [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] HTTP exception thrown: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Request method failure captured: Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: request: DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 HTTP/1.1 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept: application/json Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Accept-Encoding: identity Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Connection: close Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Length: 0 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Content-Type: application/json Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Host: 10.222.0.61 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Openstack-System-Scope: None Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Auth-Token: gAAAAABiz-3StXhBjDqCR22P4lkix2HrCXW5G2YBPicqUvD8PwfSS975dnEyQAN-MSMvgc3Qcigy1CvDGgzbNsDhVPBn8FavCH7_c8nX_ZqcKxRBPqSniuVHdsx3M8GYm-0jvMbEMTll_Zol7AcKUZx4uufjXqe9k2frFyrQLgiCe7cIIU3DuPU Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Id: None Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Domain-Name: None Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Identity-Status: Confirmed Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Is-Admin-Project: True Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Id: default Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Domain-Name: Default Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Role: reader,member Jul 14 10:25:16.456398 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Roles: reader,member Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4f945783031448849dc0e5a3337f8c76", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Id: default Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Domain-Name: Default Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Id: 7b0f433eba57485cbbfeab651a8e8b02 Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: method: > Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: exception: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.458458 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: action_args: {'id': '3a1ec4c5-369c-4368-aa74-03211ceea168'} Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: {{(pid=117809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:16.459245 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.460516 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.462325 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: DEBUG nova.api.openstack.wsgi [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Returning 404 to user: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. {{(pid=117809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:16.462325 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO nova.api.openstack.requestlog [None req-f22a16b9-e17b-4620-bfec-cab43805bbda tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 404 len: 111 microversion: 2.20 time: 0.029701 Jul 14 10:25:16.462325 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: [pid: 117809|app: 0|req: 537/1053] 10.222.0.61 () {60 vars in 1279 bytes} [Thu Jul 14 10:25:16 2022] DELETE /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:25:16.466834 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Calling method '>' {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 10:25:16.467630 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.compute.api [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] [instance: 3a1ec4c5-369c-4368-aa74-03211ceea168] Fetching instance by UUID {{(pid=117810) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 10:25:16.475255 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:16.475700 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:16.476459 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 10:25:16.476891 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG oslo_concurrency.lockutils [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Lock "a1ffe045-142f-4ef4-ace8-4e9048e3e1e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 10:25:16.493161 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.wsgi [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] HTTP exception thrown: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Request method failure captured: Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: request: GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 HTTP/1.1 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept: application/json Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Accept-Encoding: identity Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Connection: close Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Length: 0 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Content-Type: application/json Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Host: 10.222.0.61 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Openstack-System-Scope: None Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: User-Agent: python-urllib3/1.26.9 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Auth-Token: gAAAAABiz-3StXhBjDqCR22P4lkix2HrCXW5G2YBPicqUvD8PwfSS975dnEyQAN-MSMvgc3Qcigy1CvDGgzbNsDhVPBn8FavCH7_c8nX_ZqcKxRBPqSniuVHdsx3M8GYm-0jvMbEMTll_Zol7AcKUZx4uufjXqe9k2frFyrQLgiCe7cIIU3DuPU Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Id: None Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Domain-Name: None Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Identity-Status: Confirmed Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Is-Admin-Project: True Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Id: default Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Domain-Name: Default Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Role: reader,member Jul 14 10:25:16.494699 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Roles: reader,member Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4f945783031448849dc0e5a3337f8c76", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4f945783031448849dc0e5a3337f8c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Id: 4f945783031448849dc0e5a3337f8c76 Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1444491034 Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Id: default Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Domain-Name: Default Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Id: 7b0f433eba57485cbbfeab651a8e8b02 Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1444491034-project Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: method: > Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: exception: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.496390 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: action_args: {'id': '3a1ec4c5-369c-4368-aa74-03211ceea168'} Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: {{(pid=117810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 10:25:16.497465 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. Jul 14 10:25:16.498964 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: ERROR nova.api.openstack.wsgi Jul 14 10:25:16.500607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: DEBUG nova.api.openstack.wsgi [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] Returning 404 to user: Instance 3a1ec4c5-369c-4368-aa74-03211ceea168 could not be found. {{(pid=117810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 10:25:16.500607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO nova.api.openstack.requestlog [None req-d3c386ff-225e-41b7-bd04-7d0f9cbdc1c8 tempest-AttachVolumeShelveTestJSON-1444491034 tempest-AttachVolumeShelveTestJSON-1444491034-project] 10.222.0.61 "GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168" status: 404 len: 111 microversion: 2.20 time: 0.033922 Jul 14 10:25:16.500607 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: [pid: 117810|app: 0|req: 517/1054] 10.222.0.61 () {60 vars in 1276 bytes} [Thu Jul 14 10:25:16 2022] GET /compute/v2.1/servers/3a1ec4c5-369c-4368-aa74-03211ceea168 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 10:25:42.598974 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:25:42.599689 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Thu Jul 14 10:25:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:27:19.905454 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:27:19.906052 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Thu Jul 14 10:27:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:27:40.197219 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:27:40.197894 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Thu Jul 14 10:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:27:40.276811 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:27:40.277292 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Thu Jul 14 10:27:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:27:48.161064 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:27:48.161621 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Thu Jul 14 10:27:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:29:02.607005 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:29:02.607557 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Thu Jul 14 10:29:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:30:39.156520 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:30:39.157440 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Thu Jul 14 10:30:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:30:39.913815 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:30:39.914347 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Thu Jul 14 10:30:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:31:00.206058 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:31:00.206802 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Thu Jul 14 10:31:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:31:00.285987 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:31:00.286472 dv-cinder-849800-1-iscsi devstack@n-api.service[117810]: Thu Jul 14 10:31:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 10:31:08.169397 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 10:31:08.169992 dv-cinder-849800-1-iscsi devstack@n-api.service[117809]: Thu Jul 14 10:31:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!